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I  INTRODUCTION 


For  two  and  a  half  years,  Stanford  Neaearch  Institute  has 
oeen  participating  with  other  ARPA/IPT  contractors  in  a  major 
program  of  research  on  the  analysis  of  continuous  speech  oy 
computer.  The  goal  is  the  development,  over  a  five-year 
period,  of  a  speech  understanding  system  capable  of  engaging 
a  human  operator  in  a  natural  conversition  about  a  specific 
task  domain.*  During  the  first  year  of  the  SR2  project,  the 
domain  chosen  provided  int^r&cw«ons  with  a  simulated  robot 
that  knew  a>*:--v  and  could  manipulate  various  kinds  of  blocks. 
The  syste  i  im,  '-mented  during  this  period  made  major  use  of 
procedures  developed  by  winograd  (1971)  for  understanding 
sentences  in  natural  language  entered  as  text.** 

During  the  second  year  of  the  project,  a  new  task  domain 
was  chosoni  the  assembly  and  repair  of  small  appliances, 
beginning  with  a  leaky  faucet.  This  change  was  made  to 
provide  for  more  complex  interactions  of  a  user  with  the 
syetea,  involving  a  sequence  of  subtasks.  Major 
mcdifications  were  made  in  all  parts  of  the  system,  the  most 
jmportant  of  whicK  was  the  development  of  a  new  parsing 
strategy.  A  description  of  this  second  version  of  the  SRI 
speech  understanding  system  is  the  primary  content  of  this 
report.**#  section  II  contains  a  description  of  the  structure 
of  the  current  system.  Section  III  describes  the  processing 
involved  in  the  analysis  of  an  utterance.  Section  IV 
presents  the  data  available  on  system  performance. 

Recently,  and  in  accordance  with  the  recommendations 
resulting  from  the  mid-course  evaluation  of  the  Speech 
Understanding  Research  Program,  SRI  has  begun  collaboration 
w.Lth  the  System  Development  corporation  on  the  development  of 


*See  Newell,  et  al.  (1979)  for  the  recommendations  of  a  study 
group  that  led  to  the  establiahment  of  this  program.  The 
report  also  contains  specifications  of  the  parameters  for  tne 
target  systems.  References  are  located  after  section  V. 

**See  tne  First  Annual  Technical  Report  (Walker,  1973a*  for  a 
description  of  these  Initial  efforts;  also  see  wamer 
(1973b),  a  copy  of  which  is  included  as  an  attachment  to  this 
Report. 

#**3ee  walker  (1973c)  for  a  perspective  on  the  transition 
from  the  first  to  the  second  versions  of  tre  system;  walker 
(197k)  consists  primarily  of  material  from  Sections  II  and 
IV;  copies  of  each  are  attached. 
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i  Joint  system  that  will  combine  feature®  und  components  of 
the  previous  systems  developed  by  each  contractor.  The 
initial  steps  in  this  effort  are  described  in  section  V. 

Papers  prepared  under  this  project  are  included  as 
attachments  to  this  Report. 
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II  THE  STRUCTURE  OF  THE  CURRENT  SYSTEM 
A.  System  concept 

The  structure  of  the  sri  speech  understanding  system  is 
presented  in  Figure  l.  information  from  various  sources  of 
knowledge  is  coordinated  by  the  parser  to  predict  tne 
sequence  of  words  in  an  utterance  spoken  in  the  context  of  a 
particular  task  domain,  cn  the  basis  of  tnis  information,  a 
priority  is  assigned  to  each  rath  branching  from  the  current 
choice  point  in  the  grammar,  in  following  a  path,  when  a 
word  ij  predicted  for  a  particular  place  in  the  utterance,  a 
word  function  is  called.  Each  word  function  contains  a 
representation  cf  the  acoustic  features  of  that  word  baseo  on 
its  pronunciations  in  a  variety  of  contexts.  A  teat  of  the 
oatticuiar  word  function  against  acoustic  data  from  the 
utterance  returns  a  priority  for  assuming  that  the  word  is 
present.  This  value  is  part  of  the  information  used  to 
decide  which  path  to  follow  next.  A  complete  analysis  of  an 
utter. nee  produces  a  program  that  operates  on  a  model  of  the 
w„Tld  corresponding  to  the  task  domain.  The  execution  of  the 
program  constitutes  the  "understanding"  of  the  utterance; 
then,  an  appropriate  response  is  made. 


Source!  of 
Knowledge 

Grammar  and 
Semantics 
World  Model 
Information 

Uwr  and 
Discourse  Mod** 
Acoustic -Phonetic 
Analysis 


FIGURE  1  STRUCTURE  OF  THE  SRI  SPEECH  UNDERSTANDING  SYSTEM 
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B.  Task  Domain 


The  task  domain  for  the  current  system  is  a  simulation  of 
the  actions  required  for  assembly,  test,  and  repair  of  small 
mechanical  devices.  The  initial  task  is  repairing  a  leaky 
faucet.  Some  additional  information  about  this  "faucet 
world"  is  presented  in  subsection  1  under  world  Model. 


C.  Basic  System  Components 

1.  Acoustic  F' eprocessinr 

An  utterance  is  recorded  in  a  double-walled  IAC  booth, 
using  a  1-inch  condenser  microphone  and  a  studio-quality  tape 
recorder.  The  signal  is  bandpass-filtered  at  ttO-oO.OOG  hz  oy 
an  active  70  dB/cctave  filter;  it  is  then  digitized  at  20,000 
sos  with  an  11-bit  quantization,  providing  a  signal-to-noiae 
ratio  of  about  uo  dB.  Tne  digitized  wave  form  is  monitored 
on  a  CP.T  for  excessive  peak  clipping  or  underusage  of  dynamic 
range.  The  digitization  is  performed  on  a  PDP-11,  and  >;he 
results  are  transferred  by  DEC-tape  to  the  PDP-10  for  the 
next  steps  (an  interim  expedient). 

a.  Classification.  Tne  raw  signal  plus  the  outputs 
from  four  digital  filters  (80-200  Hz,  300-1000  nz, 
500-2800  Hz,  and  3200-6800  Hz)  are  used  to  classify  each 
10-ms  interval  as  vowel-like,  voiced  stop,  voiced  turbulence, 
unvoiced  turbulence,  silence,  or  transient/unknown.  T».ree 
other  digital  filters  (1500-8000  Hz,  1500-3000  Hz,  and 
kOOO-«OCO  Hz)  are  used  to  classify  turbulent  intervals  as  s, 
sh,  f-th,  z,  zh,  or  v-dh.  The  algoritnms  used  for 
classification  are  presented  in  Becker  and  Poza  (1974),  a 
copy  of  which  is  attached  to  this  Report, 

b.  Spectral  Analysis.  An  LPC  analysis  of  the  voiced 
intervals  provides  frequency  and  half-bandwidtn  values 
for  the  first  five  formants.  The  LPC  is  performed  over  a 
15-ms  interval,  using  j  dB/octave  preemphasis,  20 
coefficients,  a  Hamming  window,  and  126  estimation  points  ir. 
the  frequency  continuum. 


2.  word  Functions 

A  werd  function  is  prepared  after  a  detailed  examination  of 
acoustic  data  for  that  word  in  selected  contexts  from,  a 
variety  of  utterances.  Judgments  are  made  about  tne 
acoustic  parameters  that  are  most  relevant  and  the  variations 
in  the  parameters  that  are  most  reasonable.  Each  wora 
function  consists  of  a  series  of  FORTRAN  subroutines  that  use 
data  from  a  variety  of  sources:  the  acoustic  preprocessing 
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of  the  utterance ?,  algorithms  for  level  (volume)  detection, 
formant  smoothing,  Letectine  formant  discontinuities,  fitting 
for.'.nt  trajectories,  and  identifying  formant  bandwidths;  and 
specially  designed  iigital  filters  or  LPC  analyses. 

Spectrograms  and  the  results  of  acoustic  preprocessing  are 
available  for  almost  300  utterances.  when  the  interactive 
speed’  analysis  system  is  used  (see  walker,  1973a,  for  a 
description),  a  graphic  display  of  these  results  can  be  seen 
for  each  utterance:  specifically,  the  classification  of  10-ms 
intervals,  the  positions  of  each  of  the  first  three  formants, 
and  an  indication  of  places  in  the  utterance  wnere  changes  in 
level  are  detected,  a  photograph  of  the  display  developed  on 
transparent  acetate  and  overlaid  on  a  spectrogram  of  the 
utterance  provides  a  permanent  form  that  can  be  photocopied 
for  ease  in  handling.  A  more  detailed  representation  of  the 
acoustic  information  is  available  in  printouts  containing  all 
of  the  data  determined  for  each  lo-ms  interval  during 
acoustic  preprocessing.  Both  kinds  of  data  are  presented 
for  the  utterance  whose  processing  by  the  system  is  examined 
in  detail  in  Section  IZZ. 

The  data  base  also  can  be  processed  by  an  interactive 
program  exerciser  that  can  produce  the  values  of  any 
specified  parameters  for  portions  of  those  utterances  in  tne 
datn  base  that  contain  occurrences  of  a  particular  word.  In 
addition,  it  is  possioie  to  test  out  the  various  algorithms, 
digital  filters,  or  special  LPC  analyses  over  these  same 
intervals. 

On  the  basis  of  these  sources  of  information,  decisions  are 
nade  about  the  analysis  techniques  to  U3e  ir.  a  word  function, 
order  of  application,  and  the  appropriate  parameters. 
The  exerciser  then  is  used  tc  test  the  word  function  against 
utterances  in  the  data  base  to  determine  where  it  succeeds 
and  falls.  Threshold  changes  can  be  made  on  line, 
interactively  in  the  exerciser;  or  other  analysis  techniques 
can  be  selected  and  the  exerciser  run  again.  Forty-two  word 
functions  are  currently  available. 

A  more  detailed  description  and  evaluation  of  ;nonetic  and 
phonological  analysis  through  word  functions  is  presented  in 
*  paper  by  Becker  and  Poza  (1974),  a  copy  of  wnich  is 
included  as  an  attachment  to  this  Report. 


3.  Parsing 

The  parser  performs  a  dual  role,  in  addition  to  handling 
the  usual  parsing  functions,  it  calls  on  the  other  components 
and  coordinates  information  from  them. 
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_  «af3er  executes  %  tcp-down,  "best^first"  strategy. 
Ir^T  resuUin*  <roa  a  choice  point  is  assigned  a 

y  according  to  its  estimated  likelihood  of  arriving  at 
a  correct  parse.  These  patns  are  added  to  the  set  of  all 
possible  paths  created  but  net  yet  extended  during  tne  parse. 

,5?  _f*st*n  folloWS  the  highest  priority  path  until  its 
priority  drops  or  a  choice  point  is  reached.  At  this  time, 

t-«finiC  ,  repfats*  ''hen  the  highest  priority  path  requires 
testing  for  tne  presence  of  a  particular  word,  tne 

I£P,u??lJ!te  word  function  is  called.  a  complete  analysis  of 
an„J^  *rance  prcdUces  a  program  that  references  proceaures 
and  data  in  the  world  rocdel. 

Several  sources  of  knowledge  currently  affect  tne  value  of 
a  priority;  tne  grammar  (parameters  are  assigned  tc 

alternative  branches  at  a  choice  point,  reflecting  our 
ludgment  about  their  relative  likelihood),  tne  world  mouel, 
and  the  results  of  tie  word  function  test. 

The  basic  program.*,  for  tne  parser  are  written  in  INTErlisp, 
c -i  an  irterpreter  nas  Been  added  to  handle  multiprocessing 
control  structures  and  to  facilitate  sharing  information 
a,"on*  the  competing  processes  looking  for  a  parse,  a  single 
family  of  processes  acts  as  the  sole  producer  of  certain 
constructions  (currently  .just  simple  noun  phrases):  processes 
needing  such  constituents  provide  the  contexts  ior 
estaeiisning  priorities  within  the  family  and  act  as 
consumers  of  structures  produced  by  it. 

A  debugging  iacility  for  the  multiprocessing  control 
structures  has  been  deveicped  and  integrated  into  tne 
standard  Lis?  debugging  package,  it  allows  us  to  trace  tne 
overall  parse,  to  check  the  history  of  various  processes,  ana 
to  establish  break  poirts  in  tne  grammar. 

The  operation  of  the  parser  is  described  in  more  detail  in 
.  ecticn  Hi  and  m  papers  ty  Paxton  and  Robinson  <1^7  j; 

anm  Dovtrtw  i  i  an  <  _ _  -  . 


?nd  Paxton  (1974»,  copies 
attachments  to  this  Report. 


of  which  are  included  as 


a.  vcrld  yodel 

The  world  model  contains  data  reflecting  the  current 
configuration  of  objects  in  the  task  domain  and  procedures 
for  operating  on  that  configuration.  Tne  program  resulting 
from  a  completed  parse  will  contain  references  to  specific 
ocjects  corresponding  to  definite  descriptions  (definite  noun 
phrases  and  proper  nouns),  procedures  for  finding  objects 
satisfying  indefinite  descriptions  (other  noun  phrases),  ana 
crecedures  for  testing  or  establishing  relations  (given  cy 
verbs  and  prerositions) .  Executing  the  program  ior  an 
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imperative  produces  a  description  of  actions 
carrying  out  that  command*  Executing  the 
interrogative  produces  a  set  of  objects 
queried  relation. 


perforraea  in 
program  for  ar. 
satisfying  the 


*aucet  world  contains  a  faucet,  screws,  washers,  tools, 
and  other  objects  relating  te  pluraoing.  The  Objects  can  oe 
°f_.f  afferent  sizes  and  colors;  their  locations,  type,  and 
condition  can  be  specified.  Class  membership,  superset 
relations,  and  various  Kinds  of  connections  among  the  objects 
A  vfrl*ty  of  sctions  can  be  performed  tnat 
entail  moving,  picKing  up,  screwing,  unscrewing,  and  the 


The  current  implementation  in  QllSP  (see  Reboh  ana 
1973  ,  provides  caoeoilities  for  updatable  model 
manipulation,  including  associative  storage  and  retrieval  of 
procedures  and  data. 


S.  Response 

°f  .ay#t,e®  depends  on  t.»e  form  of  the 

cx  f*he  world,  and  the  reaulu  of 
Pro*r*®«  For  imperatives,  the  system  simply 
lists  the  actions  performed.  For  inter^ogatives,  the  type  of 

iSS  2*terBinea  ttie  feneral  form  of  the  response. 

For  example,  a  how  many"  question  is  answered  by  giving  the 

;;sw!r  •f1,  retl,rnec  the  program  for  the 

utterance  and  ^hen  describing  the  members  of  tnat  set.  In 

a  <,cf^iPt'lon  of  the  Objects,  tne  world  model  is  used 
to  find  identifying  properties  (such  as  size,  color,  ana 
type),  ana  the  utterance  phrase  corresponding  to  the  object 
(e.g..  What  bolt?1 5  is  used  to  form  a  natural  abbreviation 
(e.g..  The  small  one.*),  currently,  responses  are  typea  out 
on  the  terminal. 


r.  Sources  of  Knowledge 
1.  Grammar  and  Semantics 

The  grant.,  r  contains  clause,  noun-g- . .  *nd  verb-group 
subgrammars,  and  a  case  component.  The  clauses  .*  -e: 
najor  (declarative,  imperative,  and  question);  adjunct: 
sen  snce  complement;  and  noun-qualifying.  The  verb-group 
sub  rammar  allows*  present  and  past  tense,  active  and  passiv? 
voi  e.  and  auxiii  ry  preceding  or  separate  from  the  main 

**roup  ,ub*r*mmar  allows*  determiner, 
i?l1*S2've  10UBi  pronoun,  qualifying  phrase,  and 
C4-ause*  case  component,  verb  functions 

establish  for  each  vero  sense  its  obligatory  and  optional 
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cases--csusal  actant,  instrument,  theme,  locua,  source, 
*oal,  lcc,  and  tine.  Each  verb  function  calls  a  raradigr.  that 
scecifies  the  allowable  clause  positions  for  the  different 
case  arguments  and  naps  these  arguments  into  a  goal  state  tc 
be  achieved  in  the  world  model. 

Xhe  current  vocabulary  can  handle  5 U  words,  including  11 
rlural  and  five  past  tense  ferns,  (This  number  is  determined 
by  the  number  of  word  functions  written]  there  are  syntactic 
and  semantic  specifications  for  almost  300  words.)  Each  entry 
can  include  word  type,  syntactic  and  semantic  features,  a 
call  to  the  paradigm  (for  veros),  a  function  for  resolving 
anaphoric  reference,  information  specifically  related  to  tne 
world  model,  a  function  for  evaluating  its  priority,  and  a 
call  to  its  acoustic  word  function.  Currently,  we  can 
handle  anaphora  for  pronouns  (e.g.,  'it'  and  'one')  and  for 
definite  noun  phrases  that  are  in  case  arguments  in  the  main 
clause  of  the  sentence,  A  discussion  of  some  of  the  semantic 
and  pragmatic  processing  in  the  system  is  described  in 
3***anofsRy  (1971) ;  a  copy  is  included  as  an  attachment  to 
this  Report. 


2.  World  Model  Information 

In  addition  to  its  role  as  a  basic  system  componept,  the 
wo*"ld  model  functions  as  a  source  of  knowledge  to  affect  tne 
value  cf  priorities  in  the  parsing.  At  present,  its  use  in 
this  role  is  to  determine  whether  definite  noun  phrases  or 
prepositional  Phrases  correspond  to  some  portion  of  tne 
model.  Paxton  (19?ii)  provides  a  detailed  discussion  of  tne 
procedures  involved. 

The  presence  of  a  model  of  the  task  would  oe  a  valuable 
addition.  Therefore,  toward  this  goal,  we  have  specified 
the  sequences  of  stepo  involved  in  repairing  a  faucet  that 
has  a  worn  washer,  but  this  information  has  not  oeen 
incorporated  into  the  world  model. 


3.  User  and  Discourse  Models 

A  user  of  the  system  is  presumed  to  be  task-oriented,  in  a 
quiet  room,  and  speaking  in  a  clear,  "normal"  manner  without 
repetitions  cr  noisy  hesitation*.  Currently,  tnresr.cia 
parameters  in  the  word  functions  are  adjusted  for  the  voices 
of  two  different  speakers;  in  only  a  few  cases  nas  it  been 
necessary  to  provide  different  values  for  each.  To  extend  the 
^0  larger  numbers  of  users,  speaker-dependent 

information  would  have  to  be  incorporated  for  adequate 
discrimination. 
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The  person  using  the  system  is  assumed  more  likely  to  use 
certain  constructions.  The  initial  parameters  for  the 
priorities  of  different  rules  in  the  grammar  are  set 
according  to  our  intuitions  about  these  likelinooda. 
However*  we  recognize  the  need  to  model  the  discourse  more 
accurately;  for  example,  the  parameters  should  vary  depending 
on  progress  in  the  performance  of  the  task.  consequently* 
we  have  been  conducting  protocol  experiments  to  gather  data 
about  the  form  and  sequence  of  the  utterances  likely  to  occur 
in  dialogs  with  the  system.  3ee  Deutsch  (197k)  for  a  more 
extended  discussion;  a  copy  is  included  as  an  attachment  to 
this  Report.  Eventually,  it  may  be  possible  to  incorporate 
speaker-  dependent  information  about  the  relative  frequencies 
of  use  of  different  constructions.  Robinson  (197k)  provides 
an  extended  discussion  of  linguistic  performance  that  is 
clearly  relevant  to  modeling  differences  among  speakers;  a 
copy  of  her  paper  is  included  as  an  attachment  to  this 
Report. 


k.  Acoustic-Phonetic  Data 

Prosodic  information  can  be  critically  important  in  a 
system  of  this  design.  Accordingly,  we  have  collected  data 
from  the  protocol  experiments  to  use  to  correlate  intonation 
cues  with  sentence  type,  to  relate  stress  cues  to  the 
distinction  between  old  and  new  content  elements  in  tne 
dialog,  and  to  identify  phrase  boundaries  within  an 
utterance,  our  studies  of  utterances  parsed  by  the  system 
indicate  clearly  that  this  information  would  increase  the 
efficiency  of  the  analysis. 
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Ill  THE  ANALYSIS  OF  AN  UTTERANCE 


A.  Introduction 

This  description  of  the  analysis  of  an  utterance  will  be 
concerned  primarily  with  the  acoustic  preprocessing  and 
parsing  steps.  The  utterance  to  be  exanined  is  'what  little 
brass  parts  are  in  the  box?'  Reference  to  the  papers  by 
Seeker  and  Poza  (197b),  Paxton  and  Robinson  (1973),  Paxton 
(197b),  and  Baranofsky  (197b).  all  of  which  are  included  ae 
attachments  to  this  Report,  will  provide  more  detailed 
analyses  of  the  underlying  procedures. 


B.  Acoustic  Preprocessing 

As  described  in  Section  II,  the  initial  acoustic  processing 
of  an  utterance  provides  two  kinds  of  information  for  each 
10-ms  segment  of  the  utterance.  First,  a  segment  is 
classified  as  one  of  ten  categories  on  the  basis  of  uata 
provided  by  two  sets  of  digital  filters.  The  alternatives 
are  vowel-like,  voiced  stop,  s,  sh,  f-th,  z,  *h,  v-dh, 
silence,  and  transient/unknown.  Second,  an  lpc  analysis 
provides  frequency  and  half-bandwidth  values  for  the  first 
five  resonance  peaks.  For  voiced  segments,  these  values  can 
be  used  in  the  identification  of  formants;  the  data  gathered 
for  other  kinds  of  segments  are  not  used. 

Table  1  shows  the  classification  of  th>:  first  30  ns  of  tne 
example  utterance,  together  with  the  data  from  the  first  set 
of  digital  filters.  The  I NT  column  identifies  succcessive 
10-ns  intervals.  CL  tihews  the  classification  of  tne 
interval?  SI  for  silence,  VS  for  voiced  stop,  V  for 
vowel-like.  The  first  column  under  RAW  contains  the 
rms-values  for  the  unfiltered  signal;  all  tne  other  columns 
contain  dB  values,  normalized  so  that  the  hlgnest  value  in 
each  column  is  0.0.  Table  2  presents  the  LPC  data  for  tne 
same  intervals.  The  column  labeled  RMS  contains  the 
normalized  dB  values  provided  by  the  LPC  analysis;  they 
correspond  to  the  dB  values  in  Table  l  under  raw,  differing 
because  of  the  interval  of  tine  over  whirh  they  are  computed. 
Appendix  A  contains  the  complete  result  file  from  the 
acoustic  preprocessing  of  the  example  utterance. 

The  results  of  the  acoustic  preprocessing  can  be 
represented  graphically.  Figure  2  shows  a  spectrogram  of 
the  example  utterance.  Figure  3  shows  the  spectrogram 
overlaid  with  a  photograph  on  acetate  r  the  results  on  an 
Adage  display  terminal.  The  first  three  aks  are  shown  for 
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Table  1 


ACOUSTIC  PREPROCESSING  FOR  THE  FIRST  30  MS  Of  THE  UTTERANCE 
•WHAT  LITTLE  BRASS  PARTS  ARE  IN  THE  SOX?':  CLASSIFICATION 

WITH  DIGITAL  FILTER  OUTPUT 


DIGITAL  FILTER  OUTPUT 


INT  CL 

RAW 

VOICE  LOW  MID  HIGH 

1 

SI 

2. 

-A3, 

,0 

-50.0 

"50.0 

-50. 

0 

-AO. 

3 

2 

SI 

2. 

-A3. 

,8 

-A2.A 

-5C.0 

-50. 

0 

-Al. 

2 

3 

SI 

1. 

-A7, 

,7 

-Al.2 

-50.0 

-50. 

0 

-AO. 

3 

A 

SI 

3. 

-LI, 

.? 

-A3»6 

-50.0 

-50. 

0 

-39. 

6 

5 

SI 

2. 

-Ii7, 

,1 

-A5.9 

-50.0 

-50. 

0 

-Al. 

0 

6 

SI 

2. 

-llli. 

,6 

-A5.7 

-50. C 

-50. 

0 

-ao. 

7 

7 

SI 

3. 

-A2, 

,1 

-AO. 7 

-50.0 

-50. 

0 

-39. 

8 

8 

SI 

5. 

-37, 

,0 

-36.5 

-50.0 

-50. 

0 

-AO. 

A 

9 

SI 

10. 

-30, 

,7 

-30.0 

-A6.  A 

-50. 

0 

-AO. 

9 

10 

VS 

30. 

-21, 

,3 

-21.6 

-35.2 

-AA. 

3 

-AO. 

1 

11 

V 

150. 

-7, 

,3 

-9.8 

-15.5 

-23. 

1 

-37. 

3 

12 

V 

172. 

-6, 

.1 

-5.7 

-7.7 

-1A. 

1 

-31. 

0 

13 

V 

2  A. 

-A, 

,2 

-5.1 

-A. 7 

-11. 

5 

-27. 

3 

lb 

V 

206. 

-A, 

,6 

-5.3 

-7.1 

-11. 

A 

-21„ 

8 

15 

V 

263. 

-2, 

>  A 

-A. 5 

-A. 6 

-7. 

0 

-16. 

6 

16 

V 

235. 

-3, 

>  A 

-3.7 

-3.1 

-5. 

5 

-15. 

2 

17 

V 

296. 

-1, 

>  A 

-3.1 

-2.6 

-3. 

A 

-13. 

2 

18 

V 

3A8. 

0, 

,0 

-3.3 

0.0 

-1. 

A 

-8. 

9 

19 

V 

307. 

-1, 

,1 

-A. 2 

-0.3 

C. 

0 

-11. 

3 

20 

V 

286. 

-1, 

,7 

-5.3 

-2.6 

-2. 

A 

-7. 

3 

21 

V 

183. 

-5. 

,6 

-6.2 

-5.3 

-5. 

0 

-11. 

5 

22 

V 

108. 

-10, 

,2 

-7.3 

-17.6 

-19. 

0 

-2<>  • 

A 

23 

vs 

12. 

-13. 

,7 

-11.5 

-22.5 

-29. 

3 

-39. 

3 

2li 

V 

102. 

-10. 

,7 

-10.0 

-18.5 

-27. 

6 

-27. 

3 

25 

vs 

111. 

-9, 

,9 

-7.8 

-18.7 

-27. 

0 

-3  A. 

A 

26 

vs 

1A6. 

-7. 

,5 

-7.2 

-l6,t 

-26. 

3 

-35. 

6 

27 

V 

136. 

-8, 

,1 

-5.5 

-12.7 

-23. 

8 

-36. 

0 

28 

V 

187. 

-5, 

>  A 

-A .  1 

-11.0 

-21. 

3 

-3A. 

9 

29 

V 

175. 

-6, 

,0 

-3.1 

-10.3 

-22. 

5 

-32. 

A 

30 

V 

208. 

-A. 

,5 

-2.6 

-10.0 

-21. 

A 

-31. 

5 

11 
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Table  2 


ACOUS. :c  PREPROCESSING  FOR  THE  FIRST  30  MS  OF  TtiE  UTTERANCE  'WHaT  LITTLE 
BRASS  PARTS  ARE  IN  THE  BOX?':  CLASSIFICATION  RITn  "FORMANT-  FREQUENCE 

AND  HALF-BANCWIDTH  VALUES 


I ?C  "FORMANT"  PEAKS  IRC  HALF-BANDHIDTh  VALUES 


INT 

CL 

FI  f  2  F3  Fa  F5 

RMS 

61 

62 

63 

a* 

«5 

1 

SI 

117.  1131.  1989.  2613.  31t 32. 

-18.0 

0.0 

0.0 

0.0 

0.0 

0.0 

2 

SI 

>75.  I833.  2769.  3685.  kkk6. 

-17.7 

0.0 

0.0 

0.0 

0.0 

0.0 

3 

SI 

101U.  1716.  2301.  3276.  *095. 

-16.6 

0.0 

0.0 

0.0 

0,0 

0.0 

it 

SI 

101k.  2067.  2652.  3315.  k2!  2. 

-17. k 

0.0 

0.0 

0.0 

0.0 

0.0 

5 

SI 

936.  1550.  3k71.  k212.  53  .8. 

-18.5 

0.0 

0.0 

0,0 

o.o 

0.0 

6 

SI 

390.  1716.  2379.  3k7l.  k212. 

-17.6 

0.0 

0.0 

0.0 

0.0 

0.0 

7 

SI 

653.  1872.  3393.  k212.  kd36. 

-17.6 

0.0 

0.0 

0.0 

0.0 

0.0 

6 

SI 

1131.  1911.  296k.  3k7l.  U329. 

-18.5 

0.0 

0.0 

0.0 

0.0 

0.0 

9 

SI 

23k.  1092.  2028.  2»>i7.  35d8. 

-17.7 

0.0 

0.0 

0.0 

0.0 

0.0 

10 

V  5 

273.  1872.  2691.  3822.  kl73. 

-lk. 6 

153.2 

272.3 

213.9 

255.0 

262.6 

11 

V 

351.  702.  2886.  k797.  Sk9S. 

-7.6 

6x. 1 

153.2 

136.6 

22*. 2 

i>3 .3 

12 

V 

k29.  780.  28k7.  3276.  kk65. 

-6.7 

93.7 

123.3 

5k. 6 

67.1 

23u«* 

13 

V 

k29.  702.  2808.  3198.  k5*3. 

-5.1 

7k. 1 

163.  k 

*41.7 

126.6 

356.  7 

lit 

V 

*29.  819.  2800.  3198.  5577. 

-5.5 

100.2 

166.6 

6*.  3 

153.3 

328.3 

IS 

V 

507.  936.  27*9.  3196.  35k«. 

-3.5 

77.3 

87.1 

k&.i 

110.1 

i.39. S 

16 

V 

Sk6.  lClk.  276$.  3276.  3*66. 

-2.9 

6  7,o 

67.6 

57.6 

120.0 

163.3 

17 

V 

5e5.  1053.  2730.  3276.  3666. 

-2.C 

5  tt. 6 

36.  k 

28.8 

AC6, 8 

106,6 

16 

V 

565.  1052.  2730.  335k.  37U. 

-0.9 

5k. 6 

70.6 

100.2 

103.5 

87.1 

IS 

V 

565.  1170.  2769.  3tt32.  3622. 

-1.0 

36.* 

35.2 

113. k 

97. 0 

110.1 

20 

V 

585.  1209.  2223.  3001.  3627. 

-1.5 

67,6 

19.2 

2kk.7 

5*. 6 

83.9 

21 

V 

5k6.  12C9.  3003.  38ol.  5772. 

-3.0 

77.3 

19.2 

kk.9 

123.3 

227.6 

22 

V 

jl2.  1131.  296*.  39  78.  k660. 

-9.6 

83.9 

kk.9 

6*. 3 

170.0 

210.5 

23 

vs 

23k.  120>.  3003.  3900 .  *797. 

-11.8 

*k.9 

100.2 

106.6 

103.5 

2o2 .0 

2  a 

V 

273.  1170.  2106.  2925.  3622. 

-5.9 

22.* 

A06.6 

5k. 6 

173.3 

193.6 

25 

vs 

312.  1092.  2028.  30lt2.  3705. 

-9.6 

25.6 

26.6 

170.0 

23k.  k 

103,5 

2r 

312.  1092.  2223.  2386.  3627. 

-9.k 

20.0 

26.8 

173.3 

353.1 

77.3 

27 

V 

312.  1053.  21k5.  3081.  37kk. 

-8.6 

28.6 

32.0 

lki.  2 

200.3 

203.7 

2b 

V 

312.  1092.  21*5.  3159.  3666. 

-7.8 

16.0 

28.6 

170.0 

3ke(0 

265. k 

29 

V 

J12.  1092.  210*.  296k.  3588. 

-7.8 

19.2 

5u.6 

90. k 

220.  7 

163.3 

30 

V 

273.  1209.  2223.  3120.  J7kk. 

-7.3 

19.2 

110.1 

80.6 

170.0 

156.6 

12 


FIGURE  2  SPECTROGRAM  FOR  THE  UTTERANCE  *  WHAT  LITTLE  BRASS 

PARTS  ARE  IN  THE  BOX?' 


FIGURE  3  SPECTROGRAM  OVERLAID  WITH  RESULTS  or  irnusTTr 
PREPROCESSING  FOR  THE  UTTERANCE  ’WHAT  LITTLE  SLfS  PARTS 

ARE  IN  THE  BOX?' 
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vowel-like  segments;  ta  can  be  seen*  they  correspond 
reasonably  well  to  tne  formants.  Formant  smoothing  and  tne 
interpretation  of  discontinuities  are  done  during  word 
verification.  Tie  marks  for  the  unvoiced  portions  of  llgure 
3  are  codes  that  correspond  to  the  other  segment 
classifications.  fhe  bar  at  the  bottom  indicates  silence; 
three  closely  spaced  bars  at  the  bottom  Indicate  voiced  stop; 
three  closely  spaced  bars  at  the  top  indicate  a;  three  wlaely 
spaced  bars  down  slightly  from  the  top  indicate  f-th. 
The  arrows  at  the  bottom  of  the  spectrogram  show  changes  in 
the  amplitude  of  the  rns  output  of  the  mid-range  filter. 
These  data  actually  are  computed  during  word  verification, 
where  they  are  useful  in  determining  tne  Beginning  and  ending 
of  a  word  and  in  distinguishing  internal  features. 


C.  Parsing  an  Utterance 

The  acoustic  preprocessing  provides  the  parser  with  tne 
beginning  and  ending  points  of  the  utterance.  However, 
parsing  proceeds  independently  of  the  acoustic  data  until  a 
word  function  is  called.  There  are  nine  sections  in  the 
output  provided  fol  owing  the  parsing  of  an  utterance: 

(1)  The  actual  sequence  of  steps  in  the  parsing 

(2)  Some  statistical  data  on  the  operation  of  tne  program 

(3)  A  listing  of  the  successive  nodes  along  tne  successful 
path 

(ii)  An  identification  of  the  utterance  tnat  the  system 
"heard", 

iS)  The  response  o l  the  system  to  that  utterance 

(6)  The  parse  tree  for  the  utterance  showing  its  syntactic 
structure 

(7)  The  values  of  the  acoustic  starting  and  anding  points 
of  the  utterance 

(8)  A  listing  of  the  words  that  received  scores  other  than 
zero  in  the  acoustic  verification  steps 

(9)  A  listing  of  ail  tne  words  checked  acoustically  for  their 
presence  during  the  parse. 

Each  of  these  sections  will  be  described  for  the  utterance 
'What  little  brass  parts  are  in  the  box?'  The  complete  trace 
itself  is  provided  as  Appendix  8.  The  papers  by  Paxton  and 
Robinson  (1973)  and  by  Paxton  U97ii)  will  oe  helpful  for 
understanding  the  following  description. 


1.  Tricing  the  parse 

The  parsine  of  an  utterance  involves  tracing  through  the 
grammar  rule  by  rule*  Decisions  among  the  alternatives  at  a 
choice  point  are  made  on  the  oasis  of  initial  priorities 
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established  for  those  alternatives,  on  the  basis  of  priority 
functions  called  at  that  point,  and  on  the  oasis  of  tests 
against  the  acoustic  data  to  verify  the  presence  of  a 
particular  word* 

a*  Kinds  of  Entries  in  a  Trace.  There  are  six  different 
Kinds  of  entries  in  a  trace: 

(1)  The  start  of  the  parsing  of  some  grammatical  unit 
ENTER  PARSE  CLAUSE  AT  LOCATION  6 

The  entry  contains  the  name  of  the  grammatical  unit  and  its 
startini  location  (in  10-mo  units)  in  the  result  file 
with  the  acoustic  data  for  the  utterance. 

(2)  The  creation  of  a  process 

1  INXTSTRXNO  200 

2  " XNIT9TRING"  950 

as  each  process  is  created,  it  is  given  an  identification 
number,  a  name— which  is  the  alternative  to  be  taken  in  tne 
grammar  at  that  choice  point  when  the  process  is  activated, 
and  a  priority.  These  processes  are  added  to  the  list  of  all 
processes  created  but  not  yet  activated  during  the  parse. 
The  value  of  the  priority  is  a  function  of  the  initial 
priority  assigned  to  the  alternative  in  the  grammar,  the 
priority  of  the  path  up  to  this  point,  and  the  results  of  any 
special  priority  functions  called  when  the  process  is 
created.  These  special  priority  functions  allow  semantic, 
pragmatic,  and  other  sources  of  knowledge  to  be  used  to 
affect  the  choice  of  paths  in  a  parse  (for  details,  see 
Paxton,  197k).  The  example  above  shows  the  two  processes 
created  by  entering  the  parse  of  a  clause  (beginning  at  tne 
first  rule  in  the  clause  grammar) :  a  clause  may  be  preceoed 
by  an  initial  string— perhaps  a  sentence  adverbial— or  it 
may  be  the  first  constituent.  Since  the  parse  oegins  with  a 
priority  of  1000,  the  respective  values  of  200  and  950 
Indicate  that  the  initial  priorities  for  those  alternatives 
are  .2  and  .95. 

(3)  The  activation  of  a  process 
2  PINIT3TRING")  950  1 

The  entry  for  a  process  that  is  activated  contains  its 
number,  its  name  plus  the  names  of  the  two  previous  nodes 
along  this  path,  the  priority  of  the  process,  and  the  numoer 
of  processes  remaining  on  the  process  queue— tnat  is,  the 
ones  that  have  been  created  but  not  yet  activated. 
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(U  The  creation  of  a  family 


17  (VHNG  HHQUEST  QUEST)  8k0  12 
ENTER  PARSE  NGROUP  AT  LOCATION  3 
ENTER  FAMILY  FOR  WHNG*>IMP  AT  LOCATION  6 
NEW  FAMILY  CREATED 

In  this  eet  of  entries.  Process  17  is  activated;  it 
indicates  a  path  consisting  of  "question",  followed  oy 
"WH-question",  followed  by  "WH-noun  group".  The  priority  of 
the  rrccess  is  8kO;  there  are  12  other  processes  on  the 
rrocess  queue.  The  result  of  this  proce**  is  entry  into  the 
noun  group  grammar.  This  step  is  followed  oy  the  creation  of 
a  family,  a  device  that  allows  all  processes  looking  for  a 
noun  group  at  a  particular  location  to  share  the  sane 
information  (for  details,  see  Paxton  and  Rooinson,  1973,  and 
Paxton,  197k). 

(5)  Testing  for  a  word  in  the  acoustic  data 

26  (*WORD*  BEAUX  POLAR)  815  Ik 
AC  IS  6  O.C 

26  *W0RD*  815 

26  («W0RD«  BEAUX  POLAR)  815  lk 
AC  ARE  8  1.125  11  22 

26  *W0RD*  918 

When  a  process  calling  for  a  word  is  activated,  a  word 
verification  function  is  called  (indicated  by  "AC";  "ACAC"  is 
used  for  plurals).  If  the  word  is  not  present,  as  in  the 
first  instance,  the  location  where  the  search  was  conducted 
is  given,  followed  by  "0.0".  If  the  word  is  found,  the 
suosequent  entries  indicate  where  the  search  started,  tne 
value  of  its  priority  (the  results  of  the  acoustic  test, 
modified  according  to  gao/overlay  with  adlacent  words,  as 
described  in  Faxton,  197k),  and  tne  begirding  ana  ending 

points  of  the  word  as  provided  by  the  word  verification 

function.  The  priority  for  the  word  multiplied  by  the 
priority  for  tne  process  that  called  for  the  word  yields  the 
result  shown  on  the  last  line. 

(6)  The  end  of  the  parsing  of  some  grammatical  unit 

EXIT  PARSE  (WHN3SIMP  WHNG  QDET  PLURAL) 

226  PARTS  2233  FROM  17 

When  parsing  has  been  completed  for  a  grammatical  unit,  it  is 
indicated  by  an  entry  thit  specifies  the  grammatical 
structure  of  the  unit  parsed.  If  this  is  an  exit  frO:ii  a 
family,  then  the  next  line  will  show  a  new  process  created, 

the  last  node,  the  new  priority  value,  and  tne  number  of  the 

process  from  which  this  parse  was  entered. 
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fi.  The  sequence  of  steps  in  a  Parse.  Ir.  parsing  an 
utterance,  at  each  choice  point  in  tne  grammar,  the 
highest  priority  process  is  selected  from  the  process  queue. 
Consider  the  following  set  of  entries  taxon  from  the 
beginning  of  the  parse: 

ENTER  PARSE  CLAUSE  AT  LOCATION  9 

1  INITSTRING  200 

2  "INITSTRING"  950 
2  ( "INITSTRING" )  95C  1 

3  CECLAR  570 
!i  IMPER  912 

5  GUEST  912 

5  (QUEST  "  INITSTRING'' )  912  3 

6  WhQUEST  e75 

7  POLAR  975 

a  (IMFEA  "INITSTRING" )  912  a 

8  EMPHATIC  182 

9  NEG  182 

10  3IMPLF  0  f  5 

10  (SIMFLE  IMPEH  "INITSTRING")  075  6 

11  BE  175 

12  SIMP  8iiO 

7  (POLAR  GUEST  " INITSTRING" )  875  7 

13  DCAUX  k37 

lk  KCDALAUX  175 

15  HAVEAUX  175 

16  BEAUX  631 

6  (WHvUEST  QUEST  "INITSIPING" )  673  10 

17  WHKG  8liO 
16  -HFREP  175 
19  HO^ADJ  173 

The  parse  begins  ir  the  clause  grammar,  and  two  processes  are 
created,  as  described  above.  The  one  witn  the  nignest 

priority  (2)  is  run,  and  it  creates  tnree  processes--one  for 
declaratives,  one  for  imperatives,  and  one  lor  questions. 
There  are  now  four  processes  on  the  process  queue:  1,  3,  !i, 
and  >.  The  one  with  the  highest  priority  tnat  was  last 

entered  is  activated  first.  As  shown  in  the  remaining 

entries,  tne  parser  creates  processes  that  extend  ootn  tne 

nuestion  and  imperative  paths. 


2.  Statistics  on  Program  operation 

The  following  data,  presented  in  tne  second  part  of  the 
output  from  the  parse,  were  collected  for  tne  utterance: 

6: L8  RUNTIME 
0:17  GCIlKE 
25:2k  REAL  TIME 
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31775  CONSES 
9681  PAGE  FAULTS 
LOAD  AV  3.2  2.93  ?>SU 

Values  in  minutes  and  seconds  are  given  for  runtime,  garuage 
collection  time,  and  console  time.  CONS  is  a  LISP 
list-building  function;  it  indicates  in  a  crude  way  the  level 
of  program  activity.  Similarly,  PAOE  FAULTS  gives  an 

overall  indication  of  the  amount  of  system  overhead.  The 
LOAD  AV  values  show  the  level  of  activity  in  the  time  sharing 
system;  the  number  of  processes  in  the  ready  queue  waiting 
for  a  processor  are  shown  for  the  current  time  and  for  the 
last  10  minute  and  30  minute  periods. 


3.  The  successful  Path 

The  nodes  along  the  successful  oath  are  listed  in  the  tnird 
part  of  the  output  from  the  parses 

PATH:  ( "INITSTRING"  QUEST  WHQUEST  WHNO  QDET  WHAT  "NUM" 

ADJNOUN  ADJSTRING  "ADV"  ADJ  OADJ  LITTLE  ADJSTRINQ  "ADV"  ADJ 
OADJ  BRASS  "ADJSTRING"  NOUN  PARTS  "ENDINGS"  IULLF0RM  AUX 
BEAUX  ARE  ■ VG-MODIFIERS"  WHSUBJ  "THERE"  COP  PREPCOMPL  IN  ART 
THE  "ORD"  "NUM"  "ADJSTRINQ"  NOUN  BOX  "ENDINGS") 

A  more  detailed  listing  of  all  the  entries  in  the  parse  along 
the  successful  path  is  presented  in  Appendix  C. 


L.  The  Utterance  the  System  Heard 

The  fourth  part  of  the  output  from  the  parse  contains  tne 
utterance  identified  as  a  result  of  the  parsing: 

S/STEM  HEARD:  (WHAT  LITTLE  BFAS3  PARTS  ARE  IN  THE  BOX) 


S.  The  Response  of  the  Svstem 

The  fifth  part  of  the  output  from  the  parse  snows  the 
response  of  the  system: 

RESPONSE:  2  SCREWS 

There  were  two  little  brass  screws  in  the  box  at  the  time  the 
question  was  asked. 
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6.  The  Parse  Tree 

The  sixth  part  of  the  output  from  the  parse  contains  a  tree 
representation  of  the  syntactic  structure  of  the  utterance! 

PARSE  TREE  (CLAUSE  MAJOR  QUESTION  BE  WHQUE3T) 

SUBJECTl  FOCUSELT!  (NGKOUP  WHNGSIMP  WHNG  QDET  PLURAL) 
(WHNGSIMP  WHNG  QDET  PLURAL) 

WHAT  (QDET) 

LITTLE  (ADJ) 

BRASS  (ADJ) 

PARTS  (PLURAL  NOUN) 

MVBJ  ARE  (BE  PLURAL  PRESENT  TENSEDVERB) 

GOALPR:  IN  (PREP) 

COMPLEMENT:  (NGROUP  NGSIMP  DEF  ART  SINGULAR) 

(NGSIMP  DEF  ART  SINGULAR) 

THE  (DEF  ART) 

BOX  (SINGULAR  NOUN) 

The  utterance  is  a  WH-question  consisting  of  one  major 
clause.  Its  subject,  which  is  the  focus-element  (it  would 
not  be  for  utterances  liKe  'What  tool  do  you  want?*),  is  a 
noun  phrase  consisting  of  a  Question  determiner.  two 
adjectives,  and  a  noun.  The  main  verb  is  the  present  plural 
form  of  'be1.  There  is  a  goal  preposition,  followed  by  a 
simple  noun  phrase  as  complement. 


7.  The  starting  and  Ending  points 

The  seventh  part  of  the  output  from  the  parse  specifies,  in 
10-ms  units,  the  beginning  and  ending  prints  of  the  utterance 
in  the  acoustic  data: 

INPUT  1ITAR1  «  8 
INPUT  END  *  201 

These  values  may  be  in  interpreting  the  following 

sections. 


8.  words  Getting  Non-Zero  Scores  in  Acoustic  Tests 

The  seventh  part  of  the  trace  contains  a  list  of  the  words 
that  were  identified  as  possibly  present  during  the  acoustic 
verification  steps: 


19 


WORDS  GETTING  NONZERO  VERIFICATION  DURING  PARSE 


6 

ARE  .« 

?  11  22 

HOW  .] 

>  11  22 

WHAT  , 

,9  11  2b 

22 

THE  1, 

.0  27  37 

26 

ONE  1, 

.0  27  111 

HANDL 

2.0  23  ii? 

2 

UTIL 

1.0  27  li9 

111 

ARE  1, 

,0  liJ  19 

it  9 

THE  1 

,0  50  63 

WRENC 

.56  58  81 

2 

HANDL 

.5  50  67  2 

FAUCE 

.19216  SO 

61  2 

BOX  1, 

,0  50  So  2 

BRASS 

1.0  50  61 

63 

WRENC 

.56  6C  61 

HANDL 

. L0095  63 

87 

BOX  1, 

1 0  30  96 

81 

WRENC 

.6  97  122 

2 

PART  ] 

.,0  32  in 

2 

FAUCE 

1.0  91  15c 

87 

PLZ  .85  91  96  2 

ARE  1. 

,0  97  112 

112 

THE  1, 

,C  121  131 

lilt 

PLS  1. 

,0  lib  122 

122 

ARE  1. 

,0  126  137 

137 

THERE 

1.0  137  ns 

IN  l.C 

)  132  ns 

Iil5 

THE  1. 

,0  137  1U8 

111  8 

ON  l.C 

)  157  178 

BOX  1. 

,0  ns  2ci 

FOUND:30  TRIEDSlGli  TXMCSSlkl 

on  the  first  line,  the  number  8  indicates  the  location  at 
vnich  the  word  verification  routines  began  to  look  for  A*E. 
The  value  ,9  is  the  result  of  the  acoustic  test;  values  can 
range  fron  0.0  to  1,0.  The  last  two  numoers  are  the  beginning 
ana  ending  point*  estabxished  for  that  word.  An  extra 
number  at  the  end  of  seme  entries,  for  example,  tne  2  fer 
HANOI,  show  the  number  of  processes  that  called  for  that  word 
at  that  location;  of  course,  the  verification  test  is  only 
done  cnce.  PIZ  is  the  voiced  olural  ending;  PLS  is  tne 
unvoiced  plural  ending;  there  also  is  a  PLES  tor  plural  witn 
inserted  vowel. 

This  list  makes  it  possible  to  trace  both  the  correct  path 
and  the  partial  false  paths  in  the  parsing  in at  resulted  from 
failures  of  the  word  functions  to  reject  words,  for  tne 
correct  path,  beginning  with  WHAT,  its  end  point  directs  one 
to  words  that  begin  at  that  location;  ONE,  HANDL,  LITTLE. 
LITTLE  leads  to  k9;  BRASS  to  8lj  PART  to  1H;  PLS  to  122;  ARE 
po  137;  IN  to  1L5:  THE  to  1L8;  BOX  \o  201;  and  201  is  the  ena 
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point  cf  the  utterance.  The  sequence*  ARE  THE  ana  HO*  THE 
rre  not  continued;  no  word  is  sought  beginning  at  37*  fcHAl 
LITTLE  HANDLES  ARE  THE  did  not  continue  beyond  131.  It 
should  be  noted  that  not  all  tne  sequences  of  words  that  can 
be  constructed  from  the  list  are  on  the  sane  path.  It 
would  be  necessary  to  look  at  the  complete  trace  for  that 
information.  Paxton  (197k)  presents  all  the  false  patns,  and 
identifies  the  reasons  for  their  failing. 

The  last  line  indicates  that  30  words  were  found,  that  10k 
words  were  tried,  and  that  these  10k  werds  were  called  for 
Ikl  times;  as  indicated  above,  the  verification  test  is  aone 
only  once  for  each  word. 


9#  Words  Getting  icoustic  Tests 

The  last  part  of  the  trace  lists  all  the  words  checked 
during  the  parse.  Because  of  its  length,  tne  list  is  not 
reproduced  here;  it  is  included  in  Appendix  B.  The 
interpretation  of  the  entries  is  the  same  as  that  given  for 
the  preceding  section. 
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IV  SYSTEM  PERFORMANCE 


A.  General 

The  system  has  been  in  operation  for  only  a  few  montns. 
Burin*  this  time,  we  have  made  many  modifications  to  ensure 
that  the  various  acoustic,  syntactic,  semantic,  and  pragmatic 
processing  steps  are  working  satisfactorily.  Thus,  although 
we  have  now  processed  71  utterances,  not  all  of  them 
constitute  -tests''  of  the  system.  That  is,  in  developing 
the  algorithms  for  a  word  function,  the  acoustic  data  for  an 
utterance  may  have  been  used  in  establishing  tnresnold 
values.  our  experience  with  word  functions  is  still 
sufficiently  limit  ‘d  so  that  modifications  do  not  necessarily 
generalize  to  accommodate  the  occurrence  of  a  given  word  m  a 
different  context.  in  contrast,  changes  in  the  grammar  and 
the  semantics,  which  are  made  so  that  a  particular  utterance 
can  be  understood,  contribute  tc  the  cverall  improvement  ol 
the  system  in  a  cumulative  fashion.  Before  discussing  the 
results  for  the  ootal  set  of  utterances,  it  is  appropriate  to 
consider  the  results  for  one  block  of  ten  that  were  processed 
as  a  test  set. 


B.  analysis  of  a  Test  Set  of  Utterances 

Four  sentences  were  recorded: 

ZO  Put  one  washer  in  the  faucet. 

Z1  Grasp  the  crescent  wrench. 

22  Is  it  in  it? 

23  What  little  br«.ss  parts  are  in  the  oox? 

Three  speakers  were  used:  the  two  for  whom  thresholds  in  the 
word  functions  had  been  written  (b  and  p),  and  ore  whose 
voice  had  not  teen  recorded  for  the  system  before  (K) .  Each 
speaker  recorded  the  first  three  sentences;  the  fourth  was 
recorded  .lust  oy  the  third  speaker,  since  the  other  two  had 
recorded  it  previously. 

The  results  for  the  test  set  were  examinee  in  a  two-step 
procedure.  First,  the  word  functions  were  cnecked  against 
the  acoustic  data  for  tne  utterances;  theae  recults  are 
presented  in  Table  3.  For  three  utterances  (coincidentally, 
one  for  each  speaker)  all  of  the  word  functions  worked 
correctly.  For  four  others,  adjustments  in  thresholds  were 
made.  For  the  last  three,  a  change  in  one  of  the  algorithms 
would  have  been  required. 
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Table  3 


ACOUSTIC  RESULTS  FOP  THE  TEST  UTTERANCES: 
WORD  FUNCTIONS  REQUIRING  MODIFICATION 


Speaker  B 

Speaker  P 

Speaker  K 

ZO 

put 

put,  one, 
faucet 

washer,  in 

Z1 

wrench* 

OK 

crescent,  wrench 

22 

OK 

m* 

OK 

Z3 

little*,  part 

subtotal 

12/U  «  86% 

10/U  «  71* 

17/23  «  7A% 

Total 

39/51  -  77* 

•Algorithm  changes  would  have  been  required  for  these  words; 
only  threshold  changes  were  made  for  the  others. 


Some  examples  will  be  given  of  the  Kinds  of  thresnold 
adustnents  made.  The  values  of  the  upper  limit  for  the  first 
formant  for  several  of  the  vowels  had  to  be  changed.  For 
'put',  the  value  had  been  set  at  500,  but  in  utterance  ZO  for 
SPeaKer  B,  it  was  actually  51b.  corresponding  pairs  of 
values  for  'in*  were  500  and  533*  and  for  'crescent'  600  and 
602.  For  'faucet',  the  upper  limit  on  the  variance  about  tne 
line  fitted  to  the  second  formant  had  been  set  at  5;  in 
utterance  ZO  for  Speaker  K,  it  was  actually  *.9.  Because  of 
the  relatively  little  experience  we  have  nad  with  setting 
thresholda  for  word  functions,  these  adjustments  are  not 
considered  to  be  significant  errors  in  the  system.  Actually, 
a  change  in  the  form  of  the  threshold  cu\*off  function  from 
absolute  to  graded  would  have  accommodated  most  of  tne 
differences. 

Changing  an  algorithm  in  a  word  function  is  mere 
significant;  it  indicates  a  failure  to  account  for  a  certain 
kind  of  acoustic  event.  For  example,  in  utterance  ZJ  for 
Speaker  K,  the  second  liquid  in  'little'  had  such  a  reduced 
flao-D  that  it  could  not  be  detected  by  our  current 
algorithms.  More  adequate  detectors  would  provide  the 
discrimination  needed.  In  compiling  statistics  for  tne 
acoustic  section,  these  requirements  for  algorithmic  changes 
are  considered  fail  .res. 
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Given  these  interpretations,  the  acoustic  results  may  be 
summarized  as  indicated  at  the  bottom  of  Xable  3.  For  the 
three  speakers,  the  word  functions  were  correct  for  12/lu  * 
66%,  10/11  ■  71%,  and  17/23  ■  71%,  respectively,  the 
aggregate  value  is  39/51  ■  77*. 

The  seven  utterances  for  which  the  word  functions  were 
considered  to  work  satisfactorily  were  parsed.  First, 
however,  two  minor  chanies  were  made.  It  was  necessary  to 
raise  the  priority  for  a  construction  with  a  null  determiner 
tin  Z0),  because,  through  an  oversight  in  setting  the  initial 
parameters,  it  had  an  unrealistically  low  value.  The  word 
'is'  was  included  among  verbs  that  could  take  two  anaphoric 
references;  this  modi£\eation  had  not  been  made  rhen  that 
addition  to  our  anaphoric  routines  had  been  introduced  for 
the  other  verbs.  with  these  changes,  five  cf  the  utterances 
were  analyzed  correctly,  as  shown  in  Table  1.  For  one,  tne 
system  recognized  ’a'  rather  than  'the';  the  response  from 
the  system  would  be  the  same  in  either  case.  Zn  the  last 
utterance,  the  correct  analysis  was  found,  but  the  presence 
of  vocal  fry  at  the  end  of  the  utterance  resulted  in  a 
lowering  of  the  priority  of  that  analysis;  so,  the  parser 
continued  to  look  for  a  longer  word  and,  subsequently, 
accepted  an  Interpretation  for  which  the  values  of  the  word 
functions  actually  were  lower. 


Table  k 

PARSING  RESULTS  F0-.  THE  TEST  UT'  FRANCES 


Speaker  5 

Speaker  P 

Speaker  K 

zo 

OK 

•  a • / • the • 

OK 

Z1 

OK 

OK 

Z2 

OK 

failed 

Z3 

Subtotal 

2/2  *  100% 

2/2  >  100% 

2/3  *  67% 

Total 

6/7  ■  66% 

•Parsing  was  not  attempted  for  these  utterances. 
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To  summarize,  the  system  parsed  six  of  tne  seven  utterances 
for  a  ratine  of  86%.  If  we  include  the  three  utterances  that 
failed  on  acoustic  (rounds,  the  system  analyzed  six  out  of 
ten,  or  60%. 

The  results  from  this  set  of  test  utterances  represent  our 
first  attempt  at  an  assessment  of  the  system.  They  are  more 
valuable  to  us  as  guides  to  further  work,  than  as  benchmarks 
of  achievement.  From  this  perspective,  the  implications  of 
their  analysis  will  be  considered  in  the  next  section 
together  with  the  results  from  all  of  the  utterances  that 
have  been  processed  by  the  system. 


C.  Analysis  of  All  Processed  Utterances 

Of  the  almost  300  utterances  we  have  recorded  relating 
specifically  to  the  faucet  world  task  domain  (there  were  s.lso 
a  large  number  done  for  the  "blocks  world"),  71  have  been  run 
through  the  system.*  For  most  of  the  remainder,  there  are  not 
enough  word  functions  written  to  handle  the  vocabulary. 
About  th~ee  dozen  for  which  there  are  word  functions  have  not 
been  run,  either  because  they  contain  constructions  that  we 
n»ve  not  yet  included  in  the  grammar,  because  our  semantics 
cannot  yet  process  them,  or  because  they  do  not  make  sense. 
Utterances  in  this  last  category  were  recorded  primarily  to 
provide  alternate  acoustic  contexts  without  concern  for  their 
syntactic  or  semantic  adequacy.  (The  larger  set  of 
utterances  for  which  we  do  not  have  enough  word  functions 
also  contains  instances  of  each  of  these  three  categories.) 
Eventually,  we  would  want  the  system  to  respond  to  every 
input  in  some  constructive  manner,  but  we  believe  tnat 
efforts  in  that  direction  are  best  deferred  until  we  do 
better  on  the  utterances  the  system  should  oe  able  to 
process. 

Of  the  71  utterances  run,  the  system  returned  a  complete 
earse  with  a  resoonre  for  51*  Of  these,  nk  were  understood 
correctly.  This  number  includes  three  instances  in  which 
•a'  was  recognized  instead  of  'the';  one  with  'the'  for  'a'; 
one  with  'in'  for  'on';  and  one  with  'one'  for  'the',  in  all 
six  cases,  the  response  of  the  system  was  appropriate  for  the 
utterance  as  recorded. 

The  other  seven  utterances  were  processed  incorrectly. 
For  three,  a  path  for  the  correct  parse  also  was  present,  but 
audible  sounds  on  the  recording  after  the  last  werd  (e.g.. 


•Appendix  d  lists  all  the  sentences  recorded  for  the  faucet 
world  task  domain.  Appendix  L  lists  the  71  utterances 
processed  and  identifies  the  result  of  each  analysis. 
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vocal  try)  caused  the  ays ten  to  look  tor  an  alternative 
analysis  that  would  be  longer.  The  results  were:  'Pick  up  a 
big  wrench,'  instead  of  'Pick  up  a  big  one.';  'How  many  big 
brass  parts  are  the  handle7'  Instead  of  'How  many  big  brass 
parts  are  there?1  (clearly,  the  grammar  should  have  precluded 
that  result);  'is  there  a  wrench?'  instead  of  'is  it  \n  it7' 
(the  priorities  for  the  correct  path  were  higher,  except  for 
the  penalty  caused  by  the  faulty  identification  at  the  ena  of 
the  utterance),  in  another,  the  path  for  the  correct  parse 
present  and  the  acoustic  score  for  the  correct  word  was 
actually  higher;  however ,  the  combination  with  the  plural 
form  was  slightly  lower:  'How  many  wrenches  are  in  the  oox?' 
instead  of  'how  many  washers  are  in  the  box?'  Two  others 
accepted  incorrect  words  without  ever  considering  looking  for 
the  correct  ones:  ‘How  many  big  tools  are  on  it?'  instead  of 

* . b}-*  tooXa  *re  ere?';  'is  there  a  little  one  in 
the  faucet?  instead  of  'is  there  a  little  one  in  the  box?' 
(the  oath  leading  to  'faucet'  was  so  high  that  it  compensated 
tor  a  relatively  low  rating  for  the  acoustic  match).  In  the 
last  utterance,  a  word  function  failed,  and  a  word  witn  a 
relatively  low  acoustic  score  was  accepted:  'Is  there  a 

little  handle  in  a  box?'  instead  of  'Is  there  a  little  one  in 
the  box?1 


Twenty  utterances  never  parsed.  For  11  of  these,  the  word 
functions  failed  to  identify  words  that  were  present;  with 
one  exception  ('one'),  these  Were  function  words  ('a',  'the', 
' '•*ere')  words  with  liquids  (three  instances  of 

little' )•  A  more  refined  acoustic  analysis 
will  help  with  liquids,  but  function  words  have  long  oeen 
recognized  as  problems  for  speech  recognition  and  speech 
understanding,  and  they  will  continue  to  be.  We  believe  that 
it  may  be  possible  to  develop  syntactic  and  semantic 
strategies  that  will  compensate  for  this  kind  of  acoustic 
failure  to  some  extent. 


Another  six  utterances  terminated  by  exceeding  the  limit  on 
the  number  of  processes  that  could  be  created  (set  for  500; 
however,  each  contained  a  path  representing  a  correct 
analysis  of  the  utterance  up  to  the  point  of  termination. 
Most  cf  these  cases  resulted  from  failures  by  the  word 
functions  to  reject  words  that  were  not  present— with  a 
consequent  proliferation  of  paths  in  the  analysis.  Altnough 
better  word  functions  also  would  help  here,  other  sources  of 
knowledge  could  be  used  advantageously  to  lower  the  priority 
functions  for  paths  that  were  inappropriate  for  semantic  or 
pragmatic  reasons. 


one  utterance  failed  by  exceeding  the  limit  because  a  word 
was  erroneously  accepted  at  the  beginning  of  the  utte-ance, 
and  the  parser  never  returned  to  consider  alternative  words 
for  that  place.  Another  utterance  terminated  by  exceeding  the 
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process  limit  because  a  large  gap  between  successive  words 
reduced  the  priority  of  the  correct  path*  procedures  for 
handling  inte»"'ord  ccarticulation--required  in  any 
case-'Should  hexp.  The  last  utterance  failed  because  tne 
initial  priority  for  'one'  as  a  nour.  group  was  set  too  low; 
however,  the  word  itself  was  accepted  at  tne  appropriate 
cosition  as  an  ordinal. 

Table  5  provides  a  summary.  In  processing  (l  utterances, 
the  system  responded  as  fellows:  UK  (62*)  understood 
correctly;  7  (1C*)  understood  incorrectly;  and  20  (26»)  not 
understood.  as  indicated  atove,  the  interpretation  of  tnese 
results  is  not  clear;  not  all  of  the  analyses  constitute 
valid  tests.  However,  the  system  was  designed  to  make  use 
of  many  sources  of  Knowledge  in  the  analysis  of  an  utterance. 
Since  the  current  performance  reflects  the  use  of  only 
primitive  capabilities,  these  results  could  be  interpreted  as 
a  lower  bound  on  the  power  of  the  system. 

Kore  important  for  further  system  development,  the  analysis 
of  eacn  utterance  provides  guidance  for  modifications.  in 
addition,  we  know  how  to  refine  and  augment  each  of  the 
system  components  to  handle  inadequacies  we  already 
recognize.  Therefore,  we  relieve  that  our  experiences  with 
the  SRI  speech  understanding  system  will  prove  valuable  in 
cur  further  efforts  toward  satisfying  the  specifications  for 
system  perfornance  described  in  the  ARFA  Study  Group  Report 
(Newell,  et  al«,  1973).  now  in  conjunction  with  the  System 
I'evelopment  Corporation,  as  indicated  in  section  V. 
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Table  5 

RESULTS  FOR  UTTERANCES  PROCESSED 


Understood  Correctly 

U 

62% 

Understood  Incorrectly 

7 

10% 

Not  Unoerstood 

20 

26% 

Wcrds  Missed 

11 

Path  Proliferation 

6 

Words  Not  Rejected 

1 

Gap  Penalty 

1 

Priority  Value 

1 

TOTAL 

71 

100% 
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V  THE  DEVELOPMENT  OF  A  JUlNT  SRI-SDC  SYSTEM 


A.  Introduction 

in  accordance  with  the  recommendations  resulting  from  tne 
mid-course  evaluation  of  the  ARPA  Speech  Understanding 
Research  program*  SRI  has  begun  collaboration  with  the  system 
Development  Corporation  on  the  design  and  implementation  of  a 
joint  system.  It  will  combine  features  and  components  of 
the  previous  two  systems,  building  directly  on  the  work  of 
both  contractors  .«•  The  task  domain  selected  for  the  initial 
efforts  involves  data  management:  the  initial  data  base  will 
contain  information  about  naval  vessels  of  »he  United  States, 
the  Soviet  union,  and  the  united  Kingdom.  Following 
demonstration  of  satisfactory  progress  on  this  task,  a  second 
domain  will  be  identified,  and  subsequent  work  will  continue 
on  both  tasks. 

The  responsibility  for  the  development  of  the  Joint  system 
is  shared  by  SRI  and  SDC.  However,  SRI  will  concentrate 
primarily  on  syntax,  semantics,  pragmatics,  discourse 
analysis,  ard  prosodies,  while  SDC  will  oe  concerned 
primarily  with  signal  processing,  acoustics,  phonetics, 
phonology,  and  system  software  and  hardware  support,  ine 
initial  implementation  of  the  system  will  be  at  SDC  on  the 
Raytheon  701:  and  IBM  370/145  computers.  Accessibility  of  tne 
system  ever  the  ARFA  Computer  Network  to  other  participants 
in  tne  AFPA  program  will  be  provided  at  the  earliest  possible 
time. 

During  the  remainder  of  the  current  contract,  efforts  by 
both  SHI  and  SDC  toward  the  implementation  of  a  joint  system 
have  the  following  major  objectives: 

(1)  Developing  an  initial  operating  version  of  tne 
five-year  system;  the  SRI  parser  and  grammar  are  being 
revised  and  integrated  with  the  SDC  acoustic-phonetic  and 
ohonological  components. 

(2)  Testing  the  robustness  of  the  acoustic-phonetic 
algorithms  of  the  current  SDC  system  with  a  larger 
vocabulary  (300  words);  the  existing  SDC  predictive 
linguistic  constraints  components  are  being  used  for  tnis 
purpose. 


♦For  descriptions  of  the  current  SDC  system  activities,  see 
Ritea  (197E),  Barnett  (1974a),  Barnett  (1974b),  Kameny 
(1974),  Weeks  (1974),  Molno  (1974),  and  Ciillnann  (1974). 
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B.  Current  Activities 

The  following  tasks  are  currently  in  progress;  all  of  tnem 
will  continue  into  the  following  contract  period.  Primary 
responsibility  for  each  is  indicated  in  parentheses? 

(1)  System  Architecture.  (SRI,  SDC)  The  design  concepts 
underlying  the  systems  developed  by  SRI  and  SDC  during  the 
first  twe  years  of  the  ARPA  Frogran  are  being  reanalyzed,  and 
a  new  system  is  being  designed  that  will  combine  the 
procedures  for  syntactic,  semantic,  and  pragmatic  analysis  of 
SRI  with  the  procedures  for  acoustic,  phonetic,  and 
Phonological  analysis  of  SDC.  The  ssc  control  structure 
language  is  being  extended  tc  accommodate  the  new  design,  and 
software  support  programs  are  being  modified  accordingly. 

(2)  Protocol  Experiments.  (SHI)  We  are  locating  people  who 
are  thoroughly  familiar  with  information  retrieval  operations 
on  data  of  the  type  contained  in  the  initial  task  domain,  on 
the  basis  of  inter. lews  with  them,  a  set  of  tasks  will  oe 
identified  and  used  in  eliciting  task-oriented  dialogs. 
Early  results  will  be  used  immediately  to  determine  aaditions 
to  the  vocabulary  and  to  the  data  base,  subsequent  analyses 
will  guide  revisions  to  the  grammar  and  the  design  o t  an 
effective  discourse  model. 

(3)  Acoustic-Phonetic  Analysis.  (SDC)  The  algorithms  used 
to  build  the  A-Matrix  for  an  utterance  are  being  refined  ana 
extended,  and  new  procedures  are  being  added  to  improve  tne 
accuracy  of  the  classificatienso 

(li)  Mapping  Procedures.  (SDC)  The  current  lexical  mapping 
procedure,  with  minor  modifications,  will  oe  adequate  for 
testing  the  vocabulary  additions  using  the  current  SDC 
system.  More  substantial  cnanges  are  being  made  for 
coordination  with  the  SKI  parser  and  grammar  in  the  initial 
version  of  the  .loint  system. 

(5)  Parsing.  (SKI)  The  design  of  the  SRI  parser  is  oeing 
revised  to  accommodate  the  SDC  procedures  for 
acoustic-phonetic  analysis  and  lexical  mapping,  changes  also 
may  result  from  additions  to  the  grammar.  An  initial 
version  of  the  revised  parser  will  be  operating  in  the  new 
system  cy  September. 

(6)  Grammar.  (SRI)  A  major  reorganization  of  tne  ShI 
grammar  is  being  made.  The  selection  of  rules  for  tne 
initial  revision  will  be  guided  oy  dialogs  collected  during 
the  early  protocol  experiments.  The  structure  of  the  grammar 
is  being  changed  so  that  additions  and  modifications  can  oe 
made  more  easily. 
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(7)  Semantics.  (SRI)  Major  changes  in  the  semantics 
developed  for  the  original  SRI  tasx  domain  will  be  made 
initially  to  accommodate  the  data  management  task, 
subsequently,  as  the  data  base  is  extended  in  accord  witn  the 
findings  from  the  protocol  experiments,  additional 
modifications  will  be  made. 

(8)  System  Hardware.  (SDC)  work  is  proceeding  on  the 
ARPANET  interface  for  the  SDC  computer  facility.  as  the 
special  purpose  signal  prc^essing  and  acoustic  analysis 
computers  are  acquired,  tiiey  will  be  interfaced  into  tne 
system. 

(9)  Support  Contractors.  (SRI,  SDC)  A  set  of  tasks  is 
being  defined  that  ;an  guide  the  activities  of  other  ARPA 
contractors  so  that  they  will  begin  to  contribute  directly  to 
further  system  development. 

(10)  Management  Review.  (SRI,  SDC)  A  joint  SRI-SDC 
committee  has  been  formed  to  monitor  the  progress  of  the 
overall  effort.  It  will  meet  quarterly,  and  its 
deliberations  will  fo^m  the  basis  for  the  Quarterly 
Management  Reports.  in  addition,  technical  developments 
will  be  reviewed  monthly  by  the  two  Project  Leaders, 
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The  Result  File  from  the  Acoustic  preprocessing  of 
tne  Utterance  'What  Little  Brass  Parts  Are  in  the  Box?' 
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APPENDIX  B 


The  Trace  of  the  parse  for  the  utterance 
'What  Little  Brass  Parts  Are  in  the  Box?' 


PP8  -  What  little  bra^s  parts  are  in  the  hox? 

ENTER  PARSE  CLAUSE  AT  LOCATION  6 

1  INITSTRING  200 

2  "INITSTRING"  950 
2  ("INITSTRING")  950  1 

3  DECLAR  370 
k  IMPER  912 

5  QUEST  912 

5  (QUEST  "INITSTRING")  912  3 

6  WHQUEST  675 

7  FOLAR  675 

k  (IMPER  "INITSTRING")  912  k 
6  EMPHATIC  162 

9  NEG  162 

10  SIMFLE  875 

10  (SIMFLE  IMPER  "INITSTRING")  875  6 

11  BE  175 

12  SIMP  6E0 

7  (POLAR  QUEST  "INITSTRING")  875  7 

13  DOAUX  A37 

U  MODALAUX  175 

15  HAVEAUX  175 

16  BEAUX  831 

8  (WHQUEST  QUEST  "INITSTRING")  67 5  10 

1?  WHNG  8U0 
16  WHFREP  175 

19  HOWADJ  175 

17  (WHNG  WHQUEST  QUEST)  8fcO  12 
ENTER  PARSE  NGROUP  AT  LOCATION  6 
ENTER  FAMILY  FOR  WHNGSIMP  AT  LOCATION  6 
NEW  FAMILY  CREATED 

20  NIL  8liO 
20  NIL  dUO  12 

ENTER  PARSE  WHNGSIMP  aT  LOCATION  6 

21  HOVQ  606 

22  WNADJ  166 

23  QCET  606 
2k  QFF.ON  168 

12  (SIMP  SIMPLE  IMPER)  6E0  15 

25  «WCRD«  815 

16  (BEAUX  POLAR  QUEST)  631  15 

26  «WORD*  615 
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25  UWORD*  SIMP  SIMPLE)  815  15 
AC  USE  8  0.0 

25  *'W0RD*  815 

25  (*W0RD*  SIMP  SIMPLE)  815  15 
AC  UNSCREW  8  0.0 

25  *w0RD*  815 

25  (*WORD*  SIMP  SIMPLE)  815  15 
AC  SCREW  8  0.0 

25  *WORD*  815 

21  (#WORD*  SIMP  SIMPLE)  815  15 
AC  PUT  8  0.0 

25  *WORD*  815 

25  (*WORD*  SIMP  SIMPLE)  815  15 
PLACE  8  0.0 
25  *WORD*  815 

25  (*WORD<*  SIMP  SIMFLE)  815  15 
AC  PICK  8  0.0 

25  •WORD*  815 

25  (*WORD*  SIMP  SIMPLE)  815  15 

AC  GRASP  8  0.0 

26  (*WORL*  ?EAUX  POLAR)  815  1U 

AC  IS  8  0.0 

26  *NORD#  815 

26  (*WORD*  BEAUX  POLAR)  815  U 
AC  ARE  8  1.125  11  22 

26  *WORD*  916 

26  (*WORD*  BEAUX  POLAR)  916  lk 

27  ARE  916 

27  (ARE  BEAUX  POLAR)  916  Ik 

28  VG-MODIFIERS  183 

29  "VG-MODIFIERS"  871 

29  ("VG-MODIFIERS"  ARE  BEAUX)  871  15 

30  NG  853 

31  THERE  836 

30  (NG  "VG-MODIFIERS"  ARE)  853  16 

32  NOT-REL  8k5 

32  (NOT-PEL  NG  "VG-MODIFIERS")  8k5  16 
ENTER  PARSE  NOROUP  AT  LOCATION  22 
ENTER  FAMILY  FOR  NGSIMP  AT  LOCATION  22 
NEW  FAMILY  CREATED 

33  NIL  8k5 

33  NIL  8k5  16 

ENTER  PARSE  NGSIMP  AT  LOCATION  2? 

3k  ART  611 

35  DEMADJ  507 

36  POSSADJ  169 

37  QNTFR  507 
36  NUMD  507 

39  NUMCOMPAR  169 
kO  ATPHRASE  169 
kl  ASPHKA3E  lw9 
kk  PROPN  169 
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43  PRON  8.U 
nil  i:;:,iGpRON  169 
US  EVERPRON  169 
U6  PCSSPRON  169 
U7  POSSN  169 
48  NULL  507 

31  (THERE  HVG-M0DIFIJSRS"  ARE)  836  30 
U9  *WORD*  811 
U3  (PRON)  811  30 

50  *WORD*  0 
3U  (APT)  611  30 

51  *WORD*  795 

U9  (*WORD*  THERE  " VG-nuDlFIERS" )  811  30 
AC  THERE  22  0.0 

23  (QDET)  806  29 

52  *HORD*  782 
21  (HOWQ)  806  29 

53  *WORD*  782 

51  (*V0RD*  ART)  795  29 
AC  THE  22  1.01071U  27  37 

51  *WORD*  803 

51  (*WOSD*  ART)  803  29 
5U  THE  803 

51  *WORD*  0 

5U  (THE  ART)  803  30 

55  ORD  160 

56  "ORD"  763 

53  (*WORE#  HOWQ)  782  31 
AC  HOW  8  .6  11  22 

53  *WORD*  U69 

52  (*W0RD*  QDET)  762  31 

AC  WHAT  8  l.u  11  26 

52  *WORl*  1095 

52  (*WORP*  QDET)  1095  31 

57  WHAT  1095 

57  (WHaT  QDET)  1095  31 
56  HUM  657 

59  "NUIT  1040 

59  ("NUM"  WHAT  QDET)  1040  32 

60  ADJNOUN  986 

61  "ADJNOUN"  206 

60  (ADJNOUN  "NUM"  WHAT)  988  33 

62  AD JSTKING  890 

63  "AEJSTRING"  939 

63  ( "ADJSTRING"  ADJNOUN  "HUM")  939  34 

64  NOUN  901 

65  CLASSIFIER  901 

65  (CLASSIFIER  "ADJSTRING"  ADJNOUN)  901  35 

66  *W0RD*  883 

6a  (NOUN  "ADJSTRING"  ADJNOUN)  901  35 

67  *W0RD*  883 

62  ( ADJSTRTNG  ADJNOUN  "NUM")  890  35 
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68  ADV  17b 

69  "ADV*  bkS 

67  (*WORD*  NOUN  "ADJSTRING")  683  36 
AC  WRENCH  26  0.0 

67  *NORD*  883 

67  (*WORD*  NOUN  "ADJSTRING")  683  36 
AC  WASHER  26  0.0 

67  *WORD*  863 

67  (*WORD*  NOUN  "ADJSTRING")  883  36 
AC  TOOL  26  0.0 

67  *WORD*  883 

67  (*WORD*  NOUN  "ADJSTRING")  883  36 
THING  26  0.0 
67  *WORD*  663 

67  («HORE«  NOUN  "ADJSTRING")  883  36 
TABLE  26  0.0 
67  *WORD*  883 

67  (*WORD*  NOUN  "ADJSTRING")  8b3  36 
SINK  26  0.0 
67  *WORD*  863 

67  (#WORD*  NOUN  "ADJSTRING")  883  36 
AC  SCREWDRIVER  26  0.0 

67  *WORD*  883 

67  (*WORD*  NOUN  "ADJSTRING")  863  36 
AC  SCREW  26  0.0 

67  *WORD*  883 

67  (*WORD*  NOUN  "ADJSTRING")  883  36 
PLUG  26  0.0 
67  *W0RD*  883 

67  (*WORD*  NOUN  "ADJSTRING")  883  36 
PIPE  26  0.0 
67  *WORD*  863 

67  (*WORD*  NOUN  "ADJSTRING")  683  36 
AC  PART  26  0.0 

67  *WORD*  883 

67  (*WORD»  NOUN  "ADJSTRING")  863  36 
AC  ONE  26  1.6  27  111 

67  *WORD*  llilh 

67  (*WORD*  NOUN  "ADJSTFING" )  lklk  36 

70  ONE  llilii 
67  *WORD*  883 

70  (ONE  NOUN  "ADJSTRING")  ltlk  37 

EXIT  PARSE  (WHNGSIMP  WHNG  QDET  ANAPHOR  SINGULAR) 

71  ONE  llib7  FROM  17 

71  (ONE  NOUN  "ADJSTRING")  lk67  37 

72  ENDINQS  669 

73  "ENDINGS"  lkl3 

73  ("ENDINGS"  ONE  NOUN)  1U3  3« 

EXIT  PARSE  (NGROUP  WHNGSIMP  WHNG  QDET  ANAPHOR  SINGULAR) 
7k  FULLFORM  13U2 
75  "FULLFORM"  262 

7k  (FULLFORM  "ENDINGS"  ONE)  13k2  39 
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7k  FULLFORM  2  3k2 

7k  (FULUORM  "ENDINGS"  ONE)  13k-  39 

76  AUX  1288 

77  NOAUX  803 

76  (AUX  FULLFORM  "ENDINGS")  1288  liO 

78  DOAUX  6kk 

79  MODALAUX  257 

80  HAVEAUX  257 
61  BEAUX  1221l 

81  (BEAUX  AUX  FULLFORM)  122k  k3 
82  #WORD#  1199 

62  («WORD«  BEAUX  AUX)  1199  k3 
AC  IS  kl  0.0 

>'♦2  #WORD#  1199 

82  (»WORD«  BEAUX  AUX)  1199  k3 

AC  ARE  kl  1.25  k3  k9 

82  **ORD#  lk99 

S2  (*WORD*  BEAUX  AUX)  lk99  k3 

83  ARE  lk99 

83  (ARE  BEAUX  AUX)  lk99  k3 
8k  VG-MODIFIERS  299 

85  "VG-MODIFIERS"  lk2k 

85  ("VG-MODIFIERS"  ARE  BEAUX)  U2k  kk 

86  NCTWHSUBJ  85k 

87  VHSUBJ  1396 

87  (WH5UPJ  "VG-MODIFIERS"  ARE)  1396  k5 
67  (#WQRD*  NOUN  "ADJSTRING" )  883  kk 

AC  HOLE  26  0.0 

67  *WORJ*  883 

67  (*VORD*  NOUN  "ADJSTRING")  883  kk 
AC  HANDLE  26  1.6  23  k9 

67  «HOKD«  lklk 

<*7  (#"ORD*  NOUN  "ADJSTRING")  lklk  kk 
86  HANDLE  lklk 
67  *WCRD*  883 

88  (HANLLE  NOUN  "ADJSTRING")  lklk  k5 
EXIT  PARSE  ( WHNGSIMP  WHNG  QDET  SINGULAR) 

89  HANDLE  lk67  FROM  17 

89  (HANDLE  NOUN  "ADJSTRING" )  lk87  k5 

90  ENDINGS  669 

91  "ENDINGS"  lkl3 

91  ("FNDINGS"  HANDLE  NOUN)  lkl3  k6 

EXIT  PARSE  ( NGROUP  WHNGSIMP  WHNG  QDET  SINGULAR) 

92  FULLFORM  13k2 

93  "FULLFORM"  282 

92  (FULLFORM  "ENDINGS"  HANDLE)  13k2  k7 
92  FULLFORM  13k2 

92  (FULLFORM  "ENDINGS"  HANDLE)  13k2  k7 
9k  AUX  1288 

95  NOAUX  805 

9k  (AUX  FULLFORM  "ENDINGS")  1268  k8 

96  DOAUX  6kk 
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97  FOEhLAUX  257 
9ft  HAVhAUX  257 

99  BEAUX  1 2 2 U. 

99  (BEAUX  AUX  FULLFORM)  122k  51 

100  *WQRD*  1199 

IOC  (*WORD*  BEA'JX  AUX)  1199  51 
AC  IS  2i9  0.0 

IOC  ♦WORD*  1199 

100  (**ORD*  BEA'JX  AUX)  1199  51 

AC  ARE  Ji.9  0.0 

67  (•HOKE*  NOON  "ADJSTRING" )  603  50 
AC  FA'JCET  2e»  C.O 

67  *WORD*  Ot>3 

67  (*WORE*  NOUS’  "ADJSTRING " )  60 3  50 
AC  CArNUT  2e  0.0 

67  *W(.HD*  6  03 

67  (*W0RE*  NOUN  " ADJSTRING" )  663  50 
AC  EOX  26  C.O 

67  *WCRD*  863 

67  ( *WOEE H  NOUN  "ADJSTRING" )  663  50 
AC  BOLT  26  0.0 

67  *NCRD*  656 

66  (*’W0RD*  CLASSIFIER  "ADJSTRING " )  883  50 
AC  TOOL  26  0.0 

66  *WCHt*  683 

66  ( *WORD*  CLASSIFIER  "ADJSTRING")  883  50 
FIFE  26  C.O 

66  *WCHD*  883 

66  (*WOKD*  CLASSIFIER  "ADJSTRING")  883  50 

AC  CRESCENT  2e  0.0 

67  (*W ORE*  NOUN  "ADJSTPING" )  856  k9 

AC  WRENCHES  26  C.O 

67  *WORD*  856 

67  (*WORE*  NOUN  "AE JSTRING" )  836  49 
AC  WASHERS  26  0.0 

67  * W CPU*  3^6 

67  (♦WORT*  NCUN  "ADJSTRING")  856  k9 
rtC  TOOLS  26  0.0 

67  *W0RD*  856 

67  (*WORD*  NOUN  "ALJSTR1NG")  856  k9 
THISC.3  26  O.C 
67  **CRD*  65o 

67  (*W0KD*  NOUN  "ADJiTHING")  856  k9 
TABLES  26  0.0 
67  *WORD*  856 

67  (*W0RD»  NOUN  "ADJSTRING")  656  k9 
SINKS  26  0.0 
67  *WORD*  656 

67  (*WORD*  NOUN  "ADJSTRING")  856  19 
AC  SCREWS  26  0.0 

67  **0RD*  656 

(♦WORD*  NOUN  "ADJSTRING")  856  L9 
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AC  SCREWDRIVERS  26  0.0 

67  *W0RD*  856 

67  (*W0RD#  NOUN  "ADJSTRING" )  856  49 
PLUGS  26  0.0 
67  *WORD*  856 

67  (»WORD*  NOUN  "ADJSTRING" )  856  49 
PIPES  26  0.0 
67  *WORD*  856 

67  (#WORD*  NOUN  "ADJSTRING")  856  U9 
AC  PARTS  26  0.0 

67  «WORD*  856 

67  (#WORD#  NOUN  "ADJSTRING")  656  49 
AC  HOLES  26  0.0 

67  *WORD*  856 

67  (*WORD*  NOUN  "ADJSTRING")  856  49 
ACAC  HANDLES  26  0.0 

67  #WORD*  856 

67  (*WORD#  NOUN  "ADJSTRING")  856  49 
AC  FAUCETS  26  0.0 

© 7  *«ORD*  856 

67  (*WORD*  NOUN  "ADJSTRING")  856  49 
AC  CAPNUTS  26  0.0 

67  *WORD*  856 

67  (*NORD*  NOUN  "ADJSTRING")  856  49 
AC  BOXES  26  0.0 

67  *WOKD*  856 

67  (*WORD#  NOUN  "ADJSTRING")  856  49 
AC  BOLTS  26  0.0 

86  (NOTWHSUSJ  "VG-MODIFIERS"  ARE)  854  tt8 

101  NG  837 

102  THERE  492 

69  i  "ADV "  ADJSTRING  ADJNOUN)  845  49 

103  ADJ  811 

104  NUH5UANTITV  169 

105  ADJSUP  169 

106  ADJCOM  169 

101  (NG  NOTWHSUBJ  "VG-MODIFIERS")  837  52 

107  NOT-REL  829 

107  (NOT-REL  NG  NOTWHSUBJ)  829  52 
ENTER  PARSE  NGROUP  AT  LOCATION  49 
ENTER  FAMILY  FOR  NGSIMP  AT  LOCATION  49 
NEW  FAMILY  CREATED 

108  NIL  829 

108  NIL  829  52 

ENTER  PARSE  NGSIMP  AT  LOCATION  49 

109  ART  796 

110  DEMADJ  497 

111  FOSSADJ  165 

112  QNTFR  497 

113  NUMD  497 

114  NUMCOMPAR  165 

115  ATPHRASE  165 
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116  ASPHRA3E  165 
117  PROPN  165 
110  PFON  796 

119  THINGPRON  165 

120  EVERPROH  165 

121  POSSPRON  165 

122  FOSSN  165 

123  NULL  U97 

103  (ADJ  "ADV"  ADJSTRING)  011  66 
12k  OADJ  779 

125  VB-EN  162 

126  VB-ING  162 

95  (NOAUX  FULLF0RI1  "ENDINGS")  005  60 

127  VG-MODIFIERS  161 
120  "VG-MODIFIERS"  765 

77  (NOAUX  FULLFORM  "ENDINGS")  005  69 

129  VG-MODIFIERS  161 

130  "VG-MODIFIERS"  765 
116  (PRON)  796  70 

131  #WOFD#  0 
109  (ART)  796  70 

132  *W0RD*  700 

132  (*WORD*  ART)  760  70 
AC  THE  k9  1.25  50  63 

132  #WORD*  975 

132  (*WORD*  ART)  975  70 

133  THE  975 
132  »RORD*  0 

133  (THE  ART)  975  71 
13k  ORD  195 

135  "ORD"  926 

135  ("ORD"  THE  ART)  926  72 

136  NUM  556 

137  "NUM"  000 

137  ("NUM"  "ORD"  THE)  000  73 
136  ADJSTRING  792 
139  "ADJSTRING"  036 
139  ("ADJSTRING"  "NUM"  "ORD")  036  7k 
IkO  NOUN  0C2 
lkl  CLASSIFIER  602 

lkl  (CLASSIFIER  "ADJSTRING"  "NUM")  002  75 
lk2  *WOKD*  766 

IkO  (NOUN  "ADJSIRING"  "NUM")  002  75 
lli 3  *V0RD*  762 

130  (ADJSTRING  "NUM"  "ORD")  792  75 
lkk  ADV  156 
US  "ADV"  752 

lk2  (*#0RD*  CLASSIFIER  "ADJSTRINO" )  706  76 
AC  TO^L  63  0.0 

U2  *W0RD*  706 

lk2  ( *W0RD*  CLASSIFIER  "ADJSTRING")  706  76 
PIPE  63  0.0 
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H2  «WORD«  78 6 

lli2  (#WORE«  CLASS1FIEH  "ADJSTRINO" )  786  76 
AC  CRESCENi  63  0.0 

124  (OADJ  ADJ  "ADV")  779  75 
146  «WORD«  755 

130  ("VG-MGDIFIERS"  NOAUX  FULLFORM)  765  75 
130  "VG-MODIFIERS"  765 
13C  ("VU-MODIFIERS"  NOAUX  FUILFORM)  765  75 
126  ( "VG-MODIFIERS"  NOAUX  FUILFORM)  765  7k 
128  "VG-MODIFIERS"  765 
128  ("VG-MODIFIERS"  NOAUX  FULFOFM)  765  74 
56  ("ORE"  THE  4RT)  763  73 
lil 7  NUM  458 
1U8  "NUM"  725 

1U3  (*WCRD#  NOUN  "ADJSTKING")  762  74 
ACAC  WRENCHES  63  0.0 

143  *W'ORD«  762 

143  (*WORE*  NOUN  "ADJSTRINO" )  762  7k 
AC  WASHERS  63  0.0 

143  «WORD#  762 

lit 3  ( #WORD*  NOUN  "ADJSTRINO")  762  7k 
AC  TOOLS  63  0.0 

1U3  «VORD«  762 

1U3  (*WOFD*  NOUN  "ADJSTRINO" )  762  7k 
THINGS  63  0.0 
143  «WOPD*  762 

143  (*WORD«  NOUN  "ADJSTRINO")  762  7k 
TABLES  63  0.0 
lll3  «W0RD#  762 

143  (*WORD«  NOUN  "ADJSTRINO")  762  7k 
SINKS  63  0.0 
U3  *VORD#  762 

143  (*WORD*  NOUN  "ADJSTRINO")  762  7k 
AC  SCREWS  63  0.0 

lk3  '•WORD*  762 

143  (*WOPD*  NOUN  "ADJSTRING" )  762  7k 
AC  SCREWDRIVERS  63  0.0 

lk3  «WORD*  762 

143  (*V3RD*  NOUN  "ADJSTRING")  762  7k 
PLUGS  63  0.0 
143  *W0RD*  762 

143  (*WCPD*  NOUN  "ADJSTRIN3" )  762  7k 
PIFES  63  0.0 
143  *  *ORD*  762 

143  (*WCRD*  NOUN  "ADJSTHING" )  762  7k 
AC  PARIS  63  0.0 

143  «WOPD#  762 

143  (*WORD«  NOUN  "ADJSTRINO")  762  7k 
AC  HOLES  63  0.0 

143  «WORD*  762 

143  (*WCRD#  NOUN  "ADJSTRINO")  762  7k 
ACAC  HANDLES  63  .281615  63  96 
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Ik 3  *WORD*  762 

1U3  (*WORD#  NOUN  "ADJSTRING")  762  7k 
AC  FAUCETS  63  0.0 

H3  *WORD*  762 

1U3  (*WCRD*  NOUN  "ADJSTRING" )  762  7k 
AC  CARNUTS  63  0.0 

1U3  *WORD*  762 

1U3  (*WCRD*  NOUN  "ADJSTRING" )  762  7k 
ACAC  V  fES  63  0.0 

lk3  *WORD*  762 

lk3  (*WCRD*  NOUN  "ADJSTRING")  762  ?k 
AC  BOLTS  63  0.0 

lk3  *V0RD*  21k 

lk6  (*WORD#  OADJ  ADJ)  753  7k 
AC  WORK  26  0.0 

lk6  *WORE  755 

lk6  {*«CKD*  V  vDJ  AEJ)  755  7k 
AC  LITTLE  26  1.6  27  k9 

\k6  #WORD*  1209 
lk6  (*WORD*  OADJ  ADJ)  1209  7k 
lk9  LITTLE  1209 
lk6  #WOSD*  755 

lk9  (LITTLE  OADJ  ADJ)  1209  75 

150  ADJSTRING  1027 

1 51  "ADJSTRING”  llk8 

151  ("ADJSTRING-  LITTLE  OADJ)  llk8  76 

152  NOUN  1102 

153  CLASSIFIER  1102 

153  (CLASSIFIER  "ADJSTRING-  LITTLE)  1102  77 
15k  *N0HD*  1080 

152  (NOUN  -ADJSTRING"  LITTLE)  1102  77 
155  *WORD*  1080 

155  (*WORD*  NOUN  "ADJSTRING")  1080  77 
AC  WRENCH  k9  .3065U3  58  81 

155  *«ORD*  1080 

155  UWOPD*  NOUN  H  ADJSTRTNO- )  1080  77 
AC  WASHER  k9  0.0 

155  *WOHD*  1080 

155  (*WOPD*  NOUN  "ADJSTRINO")  1080  77 
AC  TOOL  k9  0.0 

135  *WORD*  1080 

155  (*WOrD*  NOUN  -ADJSTRINO-)  108C  77 
THING  i9  C.O 
155  *WORD*  1080 

155  ( •WORD*  NOUN  -ADJSTRING-)  1080  77 
TABLE  k9  0.0 
155  *WORD*  1C°0 

155  (*WORD*  NOUN  -ADJSTRINO")  1080  77 
SINK  k9  0.0 
155  *WORD*  1080 

155  (*WORD*  NOUN  -ADJSTRING")  1080  7'i 
AC  SCREWDRIVER  k9  0.0 
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155  *WORD*  1080 

155  (*WCPD*  NOUN  "ADJSTRING")  1080  77 
AC  SCREW  b9  0.0 

155  *WORD*  1080 

155  (*WOPD*  NOUN  "ADJSTRING" )  1080  77 
PlUO  b9  0.0 
155  *VORD*  1080 

155  (*WC <D*  NOUN  -ADJSTRING-)  1080  77 
PIPE  b9  0.0 
155  «WORD«  1080 

155  (*WCRD*  NOUN  -ADJSTRING")  1080  77 
AC  PART  b9  0.0 

155  *WORD*  1080 

155  '**ORD*  NOUN  "ADJSTRING")  1080  77 
AC  ONE  b9  0.0 

155  *WORD*  1080 

155  (*WORD*  NOUN  "ADJSTRING")  1080  77 
AC  HOLE  b9  0.0 

155  *WORD*  1080 

155  (*KORO*  NOUN  "ADJSTRING")  1080  77 
AC  HANDLE  b9  .6  50  87 

155  *WORD*  1080 

155  (♦'WORD*  NOUN  "ADJSTRING")  1080  77 
AC  FAUCET  b9  .58b9<5  50  61 

155  *WORD*  1080 

155  (*WOPD*  NOUN  "ADJSTRING")  1080  77 
AC  CAPNUT  It. 9  0.0 

155  *WORD*  1080 

155  <*WORD*  NOUN  "ADJSTRING")  1080  77 
AC  BOX  L9  1.6  50  96 

155  *WORD*  1729 

155  {*WORD*  NOUN  "ADJSTRING")  1729  77 

156  BOX  1729 
155  *WORD*  1060 

156  (BOX  NOUN  "ADJSTRING")  1729  78 

EXIT  PARSE  ( WHNGS1MP  WHNQ  QDET  SINGULA!;) 

157  BOX  1875  FROM  17 

157  (BOX  NOUN  "ADJSTRING")  1875  76 

158  ENDINGS  8)i3 

159  "ENDINGS"  1781 

159  ("ENDINGS"  BOX  NOUN)  1781  79 

EXIT  PARSE  ( NGROUP  WHNG3IMP  WHNG  QDET  SINGULAR) 

160  FULLFORM  1692 

161  "FULLFORM"  356 

160  (FULLFORM  "ENDINGS"  BOX)  1692  60 
160  FULLFORM  1692 

160  (FULLFORM  "ENDINGS"  BOX)  1692  60 

162  AUX  162b 

163  NOAUX  1015 

162  (AUX  FULLFORM  "ENDINGS")  162b  8l 
16b  DOAUX  612 
165  MODALAUX  32b 
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166  HAVEAUX  32k 

167  BEAUX  15k3 

167  (BEAUX  AUX  FULLFORM)  15k3  8k 

168  #WORD*  1512 

168  (#WOFD*  BEAUX  AUX)  1512  8k 

AC  IS  96  0.0 

168  *VORD*  1512 

168  (*WOFD*  BEAUX  AUX)  151?  8k 
AC  ARE  96  1.25  97  112 

168  *WORD*  1891 

166  (*WCRD*  BEAUX  AUX)  1691  8k 

169  ARE  1891 

*69  (ARE  BEAUX  AUX)  1891  8k 

170  VG-MODIFIERS  378 

171  "VG-MODIFIERS"  1796 

171  ( 'VG-MODIFIERS"  ARE  BEAUX)  1796  85 

172  NOTWHSUBJ  1077 

173  WHSUBJ  1760 

173  (WHSUBJ  "VG-MODIFIERS"  ARE)  1760  66 
15k  (*WOKD*  CLASSIFIER  "ADJSTRING")  1080  65 
AC  TOOL  k9  0.0 

15k  *VORD*  1060 

15k  ( *WGPD*  CLASSIFIER  "ADJSTRING" )  1080  65 
PIPE  k9  0.0 
15k  *WORD*  1080 

15k  (*WORD*  CLASSIFIER  "ADJSTRING")  1080  85 
AC  CRESCENT  k9  0.0 

155  (*VORD*  NOUN  "ADJSTRING")  1080  8k 
AC  BOLT  k9  0.0 

155  *W0RD*  10k7 

172  (NOTWHSUBJ  "VG-MODIFIERS"  ARE)  1077  6k 
17k  NG  1056 

175  THERE  62C 

17k  (NG  NOTWHSUBJ  "VG-MODIFIERS")  1056  85 

176  NOT-REL  10kS 

155  (*WCRD*  NOUN  "ADJSTRING")  10k7  85 
ACAC  WRENCHES  k9  0.0 

155  *WORD*  10k7 

155  (*WOPD*  NOUN  "ADJSTRING")  10k7  85 

ac  washers  k9  o.o 

155  *WORD*  10u7 

155  (*WOPD*  NOUN  "ADJSTHING" )  10k7  85 
AC  TOOLS  k9  0.0 

155  *WORD*  10k7 

155  (*WORD*  NOUN  "ADJSTRING")  10k7  65 
THINGS  k9  0.0 
155  *WORD*  10k7 

155  (*WORD*  NOUN  "ADJSTRING")  10k7  85 
TABLES  k9  0.0 
155  "WORD*  10k7 

155  (*WORD*  NOUN  "ADJSTRING")  10k7  65 
SINKS  k9  0.0 
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155  *VORD*  101*7 

155  (*WCRD#  NOUN  "ADJSTRINO")  101*7  85 
AC  SCREWS  li9  0.0 

155  #WORD*  101*7 

155  (*WCPD*  NOUN  "ADJSTRING")  101*7  65 
AC  SCREWDRIVERS  |*9  0.0 

155  *WCRD*  101*7 

155  (*W0RD*  NOUN  "ADJSTRING")  101*7  65 
PLUGS  1*9  0,0 
155  #WORD»  10u7 

155  i*WORD*  NOUN  "ADJSTRING" )  101*7  85 
PIPES  i*9  0.0 
155  *VORD*  101*7 

155  («WOPD#  NOUN  "ADJSTRING")  101*7  85 
AC  PARTS  1*9  0.0 

155  *VORD*  101*7 

155  (*WORD*  NOUN  "ADJSTRINO")  101*7  65 
AC  HOLES  1*9  0.0 

155  *'WORD*  101*7 

155  <*WORD#  NOUN  "ADJSTRINO")  101*7  65 
ACAC  HANDLES  1*9  .1*5  50  96 

155  *NOR0#  101*7 

155  <*W0RD#  NOUN  "ADJSTRING")  101*7  85 
ACAC  FAUCETS  1*9  0,0 

155  #WOHD#  101*7 

155  {*WOPD*  NOUN  "ADJSTRING")  101*7  65 
AC  CAPNUTS  1*9  0,0 

155  *WORD#  101*7 

155  <*WORD#  NOUN  "ADJSTRING")  101*7  85 
ACAC  BOXES  1*9  0,0 

155  "WORD*  101*7 

155  (*WCPD*  NCUN  "ADJSTRINO")  101*7  85 
AC  BOLTS  1*9  0.0 

155  *V»ORD*  61*6 

176  (NOT-REL  N3  NOTVHSUBJ)  101*5  85 
ENTER  PARSE  NGROUP  A I  LOCATION  112 
ENTER  FAMILY  FOR  NGSIMP  AT  LOCATION  112 
NEW  FAMILY  CREATED 

177  NIL  101*5 

177  NIL  101*5  85 

ENTER  PAFSE  NGSIMP  AT  LOCATION  112 

178  APT  1003 

179  EEMADJ  627 
160  POSSALJ  209 
181  QKTFR  627 

162  NUMD  627 

163  NUrtCOMFAR  209 
181*  ATPHRASE  209 
165  ASPHRASE  209 

186  PROPN  209 

187  PRON  1003 

188  THINUPRON  209 
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189  EVERPRON  209 

190  POSSPRON  209 

191  POSSN  209 

192  NULL  627 

150  (ADJSTRING  LITTLE  OADJ)  1027  99 

193  ADV  205 
19k  "ADV"  976 

163  (NOAUX  FULLFORM  "ENDINOS")  1015  100 

195  VG-MODIFIERS  203 

196  "VG-MODIFIERS H  96k 
187  ( PRON )  1003  101 

197  «WORD*  0 
176  (ART)  1003  101 

198  *«ORD*  983 

198  (*NOPD*  ART)  983  101 

AC  THE  112  ,33  m  131 

196  *VOPD*  32 li 

19k  ("ADV"  ADJSTRING  LITTLE)  976  101 

199  ADJ  937 

200  NUMQUANTITY  195 

201  ADJSUF  195 

202  ADJCOM  195 

196  ("VG-MODIFIERS"  NOAUX  FULLFORM)  96k  10k 
196  "VG-MODIFIERS"  96k 
196  ("VG-MODIFIERS"  NOAUX  FULLFORM)  96k  10k 

199  (ADJ  "ADV"  ADJSTRING)  937  103 

203  OADJ  899 
20k  VB-EN  187 

205  VB-ING  167 

203  (OADJ  ADJ  "ADV")  899  105 

206  *VORD*  872 

206  (*WORD«  OADJ  ADJ)  872  105 
AC  vORN  k9  0.0 

206  *WORD*  872 

206  (*WORD*  OADJ  ADJ)  872  105 
AC  LITTLE  k9  0.0 

206  *V0RD*  872 

206  («WCFD*  OADJ  ADJ)  872  105 
AC  BRASS  k9  1.6  50  81 

206  «WORD»  1396 

206  («WQRD»  OADJ  ADJ)  1396  105 

207  BRASS  1396 
206  «VOHD*  872 

207  (BRASS  OADJ  ADJ)  1396  106 

208  ADJSTRING  1117 

209  "ADJSTRING"  1326 

209  ( "At JSTRING"  BRASS  OALJ)  1326  107 

210  NCUN  1273 

211  CLASSIFIER  1273 

211  (CLASSIFIER  "ADJSTRING"  BRASS)  1273  108 

212  »WORD*  12k8 

210  (NOUN  "ADJSTRING"  BRASS)  1273  108 
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213  #WORD*  1246 

213  (*WORD*  NOUN  "ADJSTRING" )  1248  108 

ac  wrench  si  .isbu  97  122 

213  #WORD#  1248 

213  (*WORD*  NOUN  "ADJSTRING")  1248  106 
AC  WASHER  81  0.0 

213  *WORD*  1248 

213  (*WORB*  NOUN  "ADJSTRING" )  1248  108 
AC  TOOL  »1  0.0 

213  #W0RD*  1248 

213  (*WORD#  NOUN  "ADJSTRING")  1248  108 
THING  81  0.0 
213  #W0RD*  1248 

213  i*WCRD*  NOUN  "ADJSTRING")  1248  108 
TABLE  81  0,0 
213  *WORD*  1248 

213  (*W0RD*  NOUN  "ADJSTRING")  1248  108 
SINK  81  0.0 
213  *WORD«  1248 

213  (*WOPD*  NOUN  "ADJSTRING")  1248  108 
AC  SCREWDRIVER  81  0.0 

213  *WORD*  1248 

213  (*WOFD*  NOUN  "ADJSTRING")  1248  108 
AC  SCREW  81  0.0 

213  *WORD*  1248 

213  (*WOPB*  NOUN  "ADJSTRING")  1248  108 
PLUG  81  0.0 
213  *WJRD*  1248 

213  (*WOt«D*  NOUN  "ADJSTRING")  1248  108 
PIPE  81  0.0 
213  «WORD»  1248 

213  (*W0RD*  NOUN  "ADJSTRING")  1248  108 
AC  PART  81  1.6  82  114 

213  *VORD*  1997 

213  (*WORD«  NOUN  "ADJSTRING")  1997  108 

214  PART  1997 
213  «WORD«  1246 

214  (FART  NOUN  "ADJSTRING")  1997  109 
EXIT  PARSE  ( WHNGSIMP  WHNG  QDET  SINGULAR) 

215  PART  2233  FROM  17 

215  (PART  NOUN  "ADJSTRING")  2233  109 

216  ENDINGS  1004 

217  "ENDINGS"  2121 

217  ("ENDINGS"  PART  NCJN)  2121  110 

EXIT  PARSE  (NGROUP  WHNGSIMP  WHNG  QDET  SINGULAR) 

218  FULLFORM  2015 

219  "FULLFORM"  424 

218  (FULLFORM  "ENDINGS"  PART)  2015  111 
218  FULLFORM  2015 

216  (FULLFORM  "ENDINGS"  PART)  2015  111 

220  AUX  1934 

221  NOAUX  1209 
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220  (AUX  FULLFORM  "ENDINGS" )  193k  112 

222  EOAUX  96? 

223  MCDALAUX  386 
22k  HAVEAUX  366 

225  BEAUX  1636 

225  (BEAUX  AUX  FULLFORM)  1036  115 

226  #WORD#  1601 

226  (•WORD*  BEAUX  AUX)  1601  115 

AC  IS  Ilk  0.0 

226  #WORD#  1601 

226  (#WORD«  BEAUX  AUX)  1801  115 
AC  A  RE  1U  0.0 

212  (»WORD#  CLASSIFIER  "ADJSTRINQ")  12k6  Ilk 
AC  TOOL  61  0.0 

212  #WORD*  12k6 

212  (#WORD*  CLASSIFIER  "ADJSTRINQ")  12k6  Ilk 
PIPE  61  0.0 

212  «VORD«  12k6 

212  UWORD#  CLASSIFIER  "ADJSTRINQ" )  12k6  Ilk 

AC  CRESCENT  61  0.0 

213  (*W0RD*  NOUN  "ADJ3TRINQ" )  12k6  113 

AC  ONE  81  j.O 

213  *NORD«  12k6 

213  (*WORD*  NOUN  "ADJSTRINQ")  12k6  113 
AC  HOLE  61  0.0 

213  *W0RD*  12k6 

213  (*WORD*  NOUN  "ADJSTRINQ")  12k6  113 
AC  HANDLE  61  0.0 

213  »W0RD«  12k6 

213  (*NORD*  NOUN  "ADJSTRINQ")  12k6  113 
AC  FAUCET  61  .526  91  ISO 

213  *W0RD*  12k6 

213  (*N0RD*  NOUN  "ADJSTRINQ")  12k8  113 
AC  CAPNUT  61  0.0 

213  *WORD*  12k8 

213  (*WORD*  NOUN  "ADJSTRINQ")  12k6  113 
AC  BOX  61  0.0 

213  *WORD*  1216 

213  (*WORD*  NOUN  "ADJSTRINQ")  12k8  113 
AC  BOLT  61  0.0 

213  *W0RD*  1210 

213  (*WORD*  NOUN  "ADJSTRINQ")  1210  113 
ACAC  WRENCHES  61  0.0 

213  »WORD*  1210 

213  (*WORD*  NOUN  "ADJSTRINQ")  1210  113 
AC  WASHERS  61  0.0 

213  «WORD»  1210 

213  (*WORD*  NOUN  "ADJSTRINQ")  1210  113 
AC  TOOLS  61  0.0 

213  *WORD*  1210 

213  (*WORD*  NOUN  "ADJSTRINQ")  1210  113 
THINGS  61  0.0 
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213  "WORD*  1210 

213  ("WORD*  NOUN  "ADJSTRING" )  1210  113 
TABLES  81  0.0 
213  "WORD*  1210 

213  ("WORD*  NOUN  "ADJSTRING" )  1210  113 
SINKS  81  0.0 
213  "WORD*  1210 

213  ("WORD*  NOUN  "ADJSTRING" )  1210  113 
AC  SCREWS  81  0.0 

213  *WORD*  1210 

213  ("WORD*  NOUN  "ADJSTRING")  1210  113 
AC  SCREWDRIVERS  81  0.0 

213  "WORD*  1210 

213  ("WORD*  NOUN  "ADJSTRINQ")  1210  113 
PLUGS  81  0.0 
213  "WORD*  1210 

213  ("WORD*  NOUN  "ADJSTRINQ" )  1210  M3 
PIPES  81  0.0 
213  "WORD*  1210 

213  ("WORD*  NOUN  "ADJSTRING" )  1210  113 
ACAC  PARTS  81  1.6  82  122 

213  "WORD*  1936 

213  ("WORD*  NOUN  "ADJSTRING")  1936  113 

227  PARTS  1936 
213  "WORD*  1210 

227  (PARTS  NOUN  "ADJSTRING")  1936  11  Ji 
EXIT  PARSE  (WHNGSIMP  WHNG  QDET  PLURAL) 

228  PARTS  2233  FROM  17 

228  (PARTS  NOUN  "ADJSTRING")  2233  HE 

229  ENDINGS  lOOli 

230  "ENDINGS"  2121 

230  ("ENDINGS"  PARTS  NOUN)  2121  115 

EXIT  PARSE  ( NGHOUp  WHNGSIMP  WHNG  QDET  PLURAL) 

231  FULLFORM  2015 

232  "FULLFORM"  E2E 

231  (FULLFORM  "ENDINGS"  PARTS)  2015  116 
231  FULLFORM  2015 

231  (FULLFORM  "ENDINGS"  PARTS’  2015  116 

233  AUX  193E 
23E  NOAUX  1209 

233  (AUX  FULLFORM  "ENDINGS")  193E  117 

235  DOAUX  9  >7 

236  MODALAUX  386 

237  HAVEAUX  386 

238  BEAUX  1838 

238  (BEAUX  AUX  FULLFORM)  1838  120 

239  "WORD*  1801 

239  ("WORD"  BEAUX  AUX)  1801  120 

AC  IS  122  0.0 

239  "WORD#  1801 

239  ("WORD"  BEAUX  AUX)  1801  120 
AC  ARE  122  1.130357  126  137 
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239  *WOHD*  2036 

?39  (*WCPD*  BEAUX  AUX)  2036  120 
210  ARE  2036 

?U0  (ARE  BEAUX  AUX)  2036  120 

2 111  V0-M0EIFIERS  107 

2112  -VU-MOriFIESS"  1?31 

212  ("VG-MODIFIESS"  ARE  BEAUX)  193li  '21 

2113  N0TWHSJ3J  1160 
2U li  WHSUBJ  1695 

2liu  (WHSUBJ  "VG-MODIFIERS"  ARE)  1895  122 
2o.il.  WHSUBJ  1895 

211  (WHSUBJ  "VG-MODIFIERS"  ARE)  1895  122 
2U5  THEPE  1516 

2116  "THERE"  1600 

2k6  ("THERE"  HhSUBJ  "VG-MODIFIERS")  1800  123 

2117  PROGRESSIVE  360 
21l6  PASS  360 

2U9  COP  1530 

2Ji9  (COF  "THERE"  HHSUBJ)  153C  125 

250  NGROUP  918 

251  ALJCOMFL  1169 

252  FREPCCMPL  1169 

21i5  (THERE  WHSUBJ  "VG-MODIFIERS")  1516  127 

253  *WORD*  1171 

253  ( * WORD*  THERE  WHSUBJ)  1171  127 
AC  THERE  137  1.25  137  118 

253  *WORD*  1836 

253  (*WCRD*  THERE  WHSUoJ)  1836  127 
251  THERF  1836 

251  (THEPE  THERE  WHSUBJ)  1838  127 

255  PROGRESSIVE  367 

256  PASS  367 

257  COP  1562 

257  (COF  THERE  THERE)  1562  1?9 

258  PGCQMP  1500 

259  HCCOMF  1500 

259  (NOCOMP  COP  THERE)  1500  130 

258  (FGCCMP  COP  THERE)  1500  129 
ENTER  PARSE  FR^PG  AT  LOCATION  118 

260  •WORD*  J.U55 

252  (rREPCOMPL  COP  "THERE")  1169  129 

261  *  W  0  R  D  *  1125 

251  (ADJCCMPL  COP  "THERE")  1169  129 
ENTER  PARSE  AEJG  AT  LOCATION  137 

262  COMPAR  293 

263  AS-ADJ-AS  293 
261  THE-SAME-AS  293 
265  ADJCOMPL  1110 

260  («WCPD*  PGCOKP  COP)  1155  132 

AC  WITH  1X6  0.0 

260  »WOHD*  1155 

260  (*WOPD*  PGCOMP  COP)  1155  132 
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AC  ON  111 9  . 532lli29  157  278 

260  #W0RD*  1455 

260  ( *WQRD*  PGCOMP  COP)  U55  132 
AC  IN  111 6  0.0 

260  #VCRD*  1U55 

260  (*WCFD*  PGCOMP  COP)  lll55  132 
FROM  111®  0.0 
260  *VOPD#  lli55 

260  (*WOPD*  PGCOMP  COP)  H55  132 
AC  BETWEEN  U8  0.0 

260  »WORD*  111 55 

260  (*WORD*  PGCOMP  COP)  US5  132 

uEriIND  llid  0.0 

260  *WORD*  77 a 

261  (*VORD*  PHEPCOMPL  COP)  1U25  132 

AC  WITH  137  0.0 

261  *WORD*  lli25 

261  (*WOPD*  PREPCOMPL  COP)  Ili25  132 
AC  ON  137  0.0 

261  *VORD*  lli25 

261  (*WORD*  PREPCOMPL  COP)  H25  132 
AC  IN  137  1.25  132  lli5 

261  #VORD*  1781 

261  (*WORD*  PREPCOMPL  COP)  1781  132 

266  IN  1781 

261  »WORD«  1U25 

266  (IN  PREPCOMPL  COP)  1781  133 
ENTER  PARSE  NOROUP  AT  LOCATION  U5 
ENTER  FAMILY  FOR  NGSIMP  AT  LOCATION  H5 
NEW  FAMILY  CREATED 

267  NIL  1781 

267  NIL  1781  133 

ENTER  PARSE  NGSIMP  AT  LOCATION  lli5 


268 

ART  1710 

269 

EEMADJ  1069 

270 

POSSADJ  356 

271 

QNTFR  1069 

272 

NUMD  1069 

273 

COMPIR 

356 

271i 

ATPHRASE 

356 

275 

ASPHRASF 

356 

276 

FROPN  356 

277 

PRON  1710 

278 

THINGPRON 

356 

279 

EVLRPRON 

356 

280 

FOSSPRON 

356 

281 

POSSN  356 

282 

NULL  1069 

277  (PRON)  1710  111 7 
283  *WORD*  1676 
268  (ART)  1710  1U7 
28li  #V0  D*  1676 
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28k  (*WORD*  ART)  1676  lk7 
AC  THE  lk5  1.25  137  U8 

26k  ftWORD*  2095 
28k  (*WORD*  ART)  2095  lk7 

285  THE  2095 
26k  *WQPD*  1590 

285  (THE  ART)  2095  lk8 

286  ORD  kl9 

287  "ORD"  1990 

287  ("OFD"  THE  ART)  1990  UR 

288  NUM  119k 

289  -NUM-  1891 

289  ("NUM"  "ORD”  THE)  1891  150 

290  ADJSTRING  1701 

291  "ADJSTRING"  1796 

291  ( "ADJSTRING"  "NUM"  "ORD")  1796  151 

292  NOUN  172k 

293  CLASSIFIER  172k 

293  (CLASSIFIER  "ADJSTRINO"  "NUM")  172k  152 
29k  «WORD«  1690 

292  (NOUN  "ADJSTRINO"  "NUM")  172k  152 

295  *VORD#  1690 

290  (ADJSTRING  "NUM"  "ORD")  1701  152 

296  ADV  3kO 

297  "ADV"  1616 

295  (*WCRD*  NOUN  "ADJSTRINO")  1690  153 
THING  lud  0.0 
295  *VORD*  1690 

295  (*WOPD*  NOUN  "ADJSTRING")  1690  153 
SINK  lk8  0.0 
295  *HORD*  1690 

295  (*WORD*  NOUN  "ADJSTRINO")  1690  153 
AC  ONE  lkd  0.0 

295  *VORD*  1690 

295  (*NORD*  NOUN  "ADJSTRING")  1690  153 
AC  HOLE  lkd  0.0 

295  *VCKD*  1690 

295  (*WORD*  NOUN  "ADJSTRING")  1690  153 
AC  FAUCET  U8  0.0 

295  *WORD*  1690 

295  (*WOi>r*  NOUN  "ADJSTRING")  1690  153 
AC  bOX  lkd  1.6  lk9  201 

295  *WQHD*  270k 

295  (*WORD*  NOUN  "ADJSTRING")  270k  153 

298  BOX  270k 
295  *VORD*  1638 

298  (BOX  NOUN  "ADJSTRINO")  270k  15k 
EXIT  PARSE  (NGSIMP  DBF  ART  SINGULAR) 

299  BOX  2815  FROM  266 

299  (BOX  NOUN  "ADJSTRING")  2815  15k 

300  "ENDINGS"  2675 

300  ("ENDINGS"  BOX  NOUN)  2675  15k 
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EXIT  PARSE  ( NGROU?  NGSIMP  DEF  ART  SINGULAR) 

300  "ENDINGS"  2673 
300  ("ENDINGS”  BOX  NOUN)  2675  15U 
FXIT  PARSE  (CLAUSE  MAJOR.  QUESTION  BE  WHQUEST) 

6:k8  RUNTIME 

0:17  GCTIME 

25:2k  REAL  TIME 

31775  CONSES 

9681  PAGE  FAULTS 

LOAD  AV  3.2  2.93  2.5L 

PATH:  ( " INITSTRI NG'  QUEST  WHQUEST  WHNG  QDET  WHAT  "NUH"  ADJNOtiN 
ADJSTRINC-  "ADV"  ADJ  OADJ  LITTLE  ADJSTRING  "ADVh  ADJ  OADJ  BRAS3 
"ADJSTRING"  NOUN  PARTS  "ENDINGS"  FULLFORM  AUX  BEAUX  ARE 
"VG-MODIFILRS"  WHSUBJ  "THERE"  COP  PREPGOMPL  IN  ART  THE  "ORD" 
"NUM"  "ADJSTRING"  NOUN  BOX  "ENDINGS") 

SYSTEM  HEARD:  (WHAT  LITTLE  BRASS  PARTS  ARE  IN  THE  BOX) 
RESPONSE:  2  SCREWS 

PARSE  TREE 

(CLAUSE  MAJOR  QUESTION  BE  WHQUEST) 

SUBJECT:  FOCUSELT:  iNGROUP  WHNGSIMP  WHNG  QDET  PLURAL) 
(WHNGSIMP  WHNG  QDET  PLURAL) 

WHAT  (QDET) 

LITTLE  (ADJ) 

BRASS  (ADJ) 

PARTS  (PLURAL  NOUN) 

MVB :  ARE  (BE  PLURAL  PRESENT  TENSEDVERB) 

GOALPF:  IN  (PREP) 

COMPLEMENT:  (NGROUP  NGSIMP  DEF  ART  SINGULAR) 

(NGSIMP  DEF  ART  SINGULAR) 

THE  (DEF  ART) 

BOX  (SINGULAR  NOUN) 

INPUT  START  *  8 
INPUT  END  *  201 

WORDS  GETTING  NONZERO  VERIFICATION  DURING  PARSE 
6  ARE  .9  11  22 
HOW  .5  11  22 
WHAT  .9  11  26 
22  THE  1.0  27  37 

26  ONE  1.0  27  Ll 

HANCL  1.0  23  U 9  2 
UTIL  1.0  27  U 9 
111  ARE  1.0  L3  L9 

U9  THE  1.0  50  63 

WRENC  .56  58  81  2 
HANDL  .5  50  87  2 
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FAUCE  ,t92t8  SO  81  2 
BOX  1.0  50  9*  2 
BPASS  1.0  SO  81 
63  WRENC  .56  60  81 
HANEL  . liOOi'5  63  87 
BOX  1.0  50  96 
81  WRENC  ,8  97  122  2 
PART  1.0  82  111*  2 
FAUCE  1.0  91  150 
87  PLZ  .85  91  96  2 
96  ARE  1.0  97  112 
112  THE  1,0  12t  131 
lit  PLS  1.0  116  122 
122  A7<E  1.0  126  137 
137  THERE  1.0  137  lt8 
IN  1.0  132  lli5 
lt5  THE  1.0  137  ItS 
lt8  ON  1.0  157  178 
BOX  1.0  lt9  201 
FOUND:30  TRIED:10t  TIMESsitl 

ALL  WORES  CHECKFD  DURING  PARSE 
8  USE  0.0 
UNSCP  0.0 
SCREW  0.0 
PUT  0.0 
PICK  0.0 
GRASP  0.0 
IS  C.O 

ARE  .9  11  22 
HOW  .5  11  22 
WHAT  .9  11  26 
22  THERE  0.0 

THE  1.0  27  37 
26  WRENC  0.0  2 
WASHE  0.0  2 
TOOL  0.0  3 
SDRIV  0.0  2 
SCREW  0.0  2 
PAHT  0.0  2 
ONE  1.0  27  tl 
HOLE  0.0  2 
KANEL  1.0  23  t9  2 
FAUCE  0.0  2 
CAPNU  O.C  2 
BOX  0.0  2 
BOLT  0.0  2 
CPESC  0.0 
WORN  0.0 
LITTL  1.0  27  L9 
tl  IS  0.0 

ARE  1.0  L3  U9 


k 
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U9  IS  0.0 
ARE  0.0 
PLZ  0.0 
THE  1.0  50  63 
WRENC  .56  56  61  2 
WASHE  0.0  2 
TOOL  0.0  3 
SDRIV  0.0  2 
SCREW  0.0  2 
PART  0.0  2 
ONE  0.0 
HOLE  0.0  2 
MANEL  .5  50  87  2 
FAUCE  .U92U8  50  81  2 
CAPNU  0.0  2 
BOX  1.0  50  96  2 
CRESC  0.0 
BOLT  0.0  2 
WORN  0.0 
LITTL  0.0 
BRASS  1.0  50  81 

63  TOOL  0.0  2 
CRESC  0.0 
WRENC  .56  60  81 
WASHE  0.0 
SCREW  0.0 
SDRIV  0.0 
PART  0.0 
HOLE  O.U 

HANDL  .U0095  63  87 
FAUCE  C.O 
CAPNU  0.0 
BOX  1.0  50  96 
BOLT  0.0 

81  PLES  0.0  2 
PLS  0.0 

WRENC  .8  97  122  2 
WASHE  0.0  2 
TOOL  0.0  3 
SDRIV  0.0  2 
SCREW  0.0  2 
PART  1.0  82  lilt  2 
CRESC  0.0 
ONE  0.0 
HOLE  0.0 
HANDL  0.0 
FAUCE  1.0  91  150 
CAP*  U  0.0 
BOX  0.0 
BOLT  0.0 

87  ?LZ  .85  91  96  2 

96  PLES  0.0  2 
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ZS  0.0 

ARE  1.0  97  112 
112  THE  1.0  12 U  131 
1H  IS  0.0 
ARE  0.0 

PLS  1.0  116  122 
122  PLES  0.0 
IS  0.0 

iRE  1.0  126  137 
137  THERE  1.0  137  U6 
*ITH  0.0 
ON  0.0 

ZN  1.0  132  U5 
1*5  THE  1.0  137  1*6 
U6  WITH  0.0 

ON  1.0  157  176 
ZN  C.O 
BETHE  0.0 
ONE  0.0 
HOLE  0.0 
FAUCE  0.0 
BOX  1.0  Ik 9  201 
F0UND:3C  TRZEDtlO*  TZMESjUI 


8*  2H 


■ . . . •  ■PLiiiiMii9!(pnHq||||| 


APPZNDIX  C 

The  Successful  Path  of  the  Parte  lor  the  Utterance 
■what  Little  Bras*  Parts  Are  in  the  Box?' 


PP8  -  What  little  brass  parts  are  in  the  oox7 

ENTER  PARSE  CLAUSE  AT  LOCATION  d 
2  ("INITSTRING")  950  1 
5  (QUEST  ' INITSTRING" )  912  3 
5  (WRQUEST  QUEST  "INITSTRING")  875  10 
17  ( WHNG  WHQUEST  QUEST)  8kO  1C 
ENTER  PARSE  NGROUP  AT  LOCATION  8 
ENTER  FAMILY  FOR  VHKOSXKP  AT  LOCATION  8 
NEW  FAMILY  CREATED 
ENTER  PAPSE  WHNGSIMP  AT  LOCATION  8 
23  (QDET)  806  29 
52  (*NORE#  QDET)  78?  31 
AC  WHAT  8  l.k  11  26 

57  (WHAT  QDET)  1095  31 

59  ("NUM"  WHAT  QDET)  10k0  32 

60  (ADJNOUN  "NUM"  WHAT)  965  33 

62  (ADJSTRING  ADJNOUN  "NUM")  890  35 
69  ("ADV"  ADJSTRING  ADJNOUN)  8u5  k9 
103  (ADJ  "ADV"  ADJSTRING)  811  66 
12k  (OAEJ  ADJ  "ADV")  779  75 
lk6  (•WORD*  OADJ  ADJ)  755  7k 
AC  LITTLE  26  1.6  27  k9 

U9  (LITTLE  CAEJ  ADJ)  1209  75 
150  (ADJSTRING  LITTLE  OADJ)  1027  99 
19k  ("ADV"  ADJSTRING  LITTLE)  976  101 
199  (AD:  "ADV"  ADJSTRING)  937  103 
203  (uAEJ  ADJ  "ADV")  899  105 

206  (*NORD*  OADJ  ADJ)  872  105 

AC  BRASS  k9  1.6  50  81 

207  (BRASS  OADJ  ADJ)  1396  106 

209  ("ADJSTRING"  BRASS  OALJ)  1326  107 
21C  (NOUN  "ADJSTRING"  BRASS)  1273  108 
213  (*WCFD*  NOUN  "ADJ3TRINQ")  1210  113 
ACAC  PARTS  81  1.6  82  122 

227  (PARTS  NOUN  "ADJSTRING")  1936  Ilk 
EXIT  PARSE  (nHNGSIMP  WHNG  QDET  PLURAL) 

228  PARTS  2233  FROM  17 

228  (PARTS  NOUN  "ADJSTRING")  2233  1U 

230  ("ENDINGS"  PARTS  NOUN)  2121  115 

EXIT  PARSE  (NGROUP  WHNGSIMP  WHNG  ODET  PLURAL) 

231  (FULLFORM  "FADINGS"  PARTS)  2015  116 
233  (AUX  FULLFORM  "ENDINGS")  193k  117 
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236  (BEAUX  AUX  FULLFORM)  1838  120 

239  ( *WORD*  BEAUX  AUX)  1801  120 

AC  ARE  122  1.130357  126  137 

2A0  ( ARE  BEAUX  AUX)  2036  120 

21i2  ("VG-MODIFIERS"  ARE  BEAUX)  193k  121 

2kk  (WHSUBJ  "VG-MODIFIERS"  ARE)  1695  122 

2k6  ( "THERE"  WHSUBJ  "VG-MODIFIERS" )  1800  123 

2k9  (COP  "THERE"  WU3UBJ)  1530  125 

252  ( PREPCOMPL  OOF  "THERE")  lk69  129 

261  ( #WORD*  PREPCOMPL  COP)  lk25  132 

AC  IN  ?  S'*  1.25  132  US 

266  (IN  PREPCOMPL  COP)  1781  133 

ENTER  PARSE  NGROUP  AT  LOCATION  U5 

ENTER  FAMILY  FOR  NGSIMF  AT  LOCATION  U5 

NEW  FAMILY  CREATED 

ENTER  PARSE  NGSIMP  AT  LOCATION  U5 

268  (ART)  1710  U7 

AC  THE  U5  1.25  137  lk8 

285  (THE  ART)  2095  U8 

28?  ("ORD"  THE  ART)  1990  U9 

289  ("NUM"  "ORD"  THE)  1891  150 

291  ("ADJSTRING"  "NUM"  "ORD")  1796  151 

292  (NOUN  "ADJSTRING"  "NUM")  172k  152 

295  (’♦WORD*  NOUN  "ADJSTRING")  1690  153 
AC  BOX  U8  1.6  U9  201 

298  (BOX  NOUN  "ADJSTRING")  270k  15k 
EXIT  PARSE  MGSIMP  DEF  ART  SINGULAR) 

299  BOX  2815  FROM  266 

299  (BOX  NOUN  "ADJSTRING")  2815  15k 

300  ("ENDINGS"  BOX  NOUN)  2675  15k 

EXIT  PARSE  (NGROUP  NGSIMP  DEF  ART  SINGULAR) 

300  ("ENDINGS"  BOX  NOUN)  2675  15k 

EXIT  PARSE  (CLAUSE  MAJOR  QUESTION  BE  WHQUEST) 
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Sentences  Recorded  for  the  'Faucet  world'  task  Domain* 


Group  H 


0  Grasp  it  between  the  two  holes, 

1  Now  bolt  the  parts  tofether, 

2  Does  the  bolt  fit  in  the  hole? 

3  Can  you  (rasp  a  bolt  by  the  head? 
k  Please  (rasp  it  now, 

5  Grasp  the  part  with  a  hole  between  the  bolts, 

6  Bolt  the  two  two  inch  bolts  tocether, 

7  Put  two  holes  tocether  to  (rasp, 

8  Now  it  can  be  put  tocether, 

9  Put  a  part  between  a  hole  and  the  part. 


Group  I 


0  Grasp  two  wincbolts  tocether. 

1  Bolt  it  now  with  two  parts. 

2  Will  it  fit  between  the  holes? 

3  Can  you  now  crasp  the  part? 
u  Can  you  put  it  tocether  now? 

5  Now  put  it  between  two  new  parts. 

6  Move  a  hole  between  them. 

7  Place  two  bolts  tocether. 

8  Between  one  and  two  inches. 

5  Now  we've  cot  it  all  tocether. 


Group  J 


0  Fix  the  worn  faucet  later. 

1  Now  unscrew  the  old  screw. 

2  Now  fix  two  worn  valves. 

3  Next  unscrew  an  old  bolt. 

k  Fix  a  new  valve  in  the  faucet. 

5  Then  we  car  screw  on  a  new  one. 

6  Can  we  fix  the  same  old  faucet? 

7  After  we  bolt  it  you  can  fix  it. 

8  Turn  off  the  sane  valve  later* 

9  Then  turn  on  the  next  valve. 


♦The  sentences  in  Groups  H  throuch  s  were  recorded  by  two 
speakers.  Group  N  was  recorded  a  second  time  by  the  same 
speakers  as  if  in  response  to  a  request  from  the  system  to 
repeat  their  first  utterances.  The  first  three  sentences  in 
Group  2  were  recorded  by  the  previous  two  speakers  and  by  a 
third  ont •  The  latter  alone  recorded  the  fourtn  sentence  in 
that  Grout  > 
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Group  K  0  Turn  off  the  sane  faucet. 

1  I  bolted  an  old  one  on. 

2  Then  I  fixed  the  new  valve. 

3  Next  I  unscrewed  the  sane  one. 
b  Can  you  screw  it  on  later? 

5  Unscrew  one  after  we  fix  it. 

6  Will  you  turn  off  the  next  valve? 

7  We  unscrewed  it  later  on. 

6  Turn  the  *aucet  off  and  on. 

9  The  worn  one  screws  on  next. 


Group  L  c  Put  a  screw  in  the  hole. 

1  Did  you  put  a  screw  in  the  hole? 

2  Turn  the  screw  two  turns. 

3  What  part  is  in  the  hole? 
ii  1  out  a  worn  bolt  in. 

5  Put  the  new  faucet  toiether. 

6  Now  put  a  valve  in  between. 

7  After  that  (rasp  a  bolt. 

G  After  you  fix  the  sane  part. 

9  Can  we  fix  a  worn  valve? 


Group  H  0  z  xrasped  the  old  part. 

1  You  put  one  on  later. 

2  We  unscrewed  it  after  that. 

3  Now  turn  off  the  old  parts, 
b  After  you  turn  the  old  one. 

5  Then  I  can  grasp  two. 

6  Now  put  in  the  sane  bolt. 

7  Turn  a  new  and  old  screw. 

6  Then  unscrew  one  later. 

9  The  worn  faucet's  next. 


Group  N  0  Grasp  the  handle  with  a  hole  in  it. 

1  Put  the  handle  on  the  faucet. 

2  Screw  a  big  screw  in  the  handle. 

3  Is  there  a  crescent  wrench  in  the  box? 
b  Unscrew  the  capr.ut  with  t*e  little  one. 

5  Is  the  washer  in  the  faucet  worn? 

6  Pick  up  the  big  screwdriver. 

7  Use  it  to  unscrew  the  brass  screw. 

6  Hew  mar.y  parts  are  there? 

9  What  tools  are  in  the  box? 
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Group  o 


Group  P 


Group  « 


Group  R 


C  Pick  up  tne  worn  crescent  wrench. 

1  wnere  are  the  washers  for  the  faucets? 

2  How  nany  washers  are  in  the  dox? 

3  There  is  a  bif  screwdriver  in  the  box. 
li  Pick  up  tne  little  pipe  wrench. 

5  Grasp  the  handle  on  the  faucet. 

6  Use  a  little  washer  in  the  big  box. 

7  Is  the  screwdriver  on  th*  worn  handle? 

8  How  nan y  big  tools  are  there? 

9  Is  one  a  little  crescent  wrench? 


0  Pick  up  tne  little  wrench  oy  the  capnut, 

1  Pick  up  the  big  brass  wasner  by  the  box, 

2  Are  tnere  nany  washers  by  the  screwdriver? 

3  How  nany  tools  are  on  the  table? 

a  Use  the  crescent  wrench  to  put  the  capnut  on. 
3  Is  there  a  little  tool  in  the  box? 

6  Is  the  handle  on  the  big  bolt? 

7  What  tool  is  used  to  screw  things? 

8  wnat  little  brass  parts  are  in  the  box? 

9  How  nany  capnuts  are  on  the  table? 


u  The  big  brass  part  on  the  faucet  is  the  handle. 

1  The  little  part  on  the  handle  is  the  capnut. 

2  There  is  a  washer  between  the  capnut  and  the 
handle. 

3  How  is  a  screwdriver  used? 

i  Pick  uo  the  washer  by  the  screwdriver. 

5  Use  a  screwdriver  to  screw  it  in. 

6  The  Dig  tool  is  a  crescent  wrench. 

7  The  little  brass  washer  is  or  the  table, 

8  How  nany  big  brass  parts  are  there? 

9  What  wrench  is  in  the  box? 


0  Place  the  plug  in  the  hole  ir.  the  sink. 

1  Put  the  black  bipe  wrench  on  the  table. 

2  Is  the  plug  behind  the  box? 

3  Place  it  on  too  of  the  box. 

k  Place  the  faucet  in  the  sink. 

5  What  is  in  back  of  the  faucet? 

6  Wnat  slack  tools  are  behind  the  box? 

7  Put  tne  pipe  wrench  on  top  of  the  table. 
a  is  there  a  tool  in  back  of  the  box? 

9  How  nany  washers  are  black? 
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Group  s 


Group  z 


0  Screw  the  acrew  in  it* 

1  Put  it  on  the  faucet. 

2  Pick  up  a  big  oner 

3  Za  there  a  little  one  in  the  box? 
b  la  it  on  the  box? 

5  What  toola  are  in  the  big  one? 

6  Unecrew  a  little  braaa  one. 

7  Screw  a  acrew  in  the  handle  with  it. 

6  unecrew  the  capnut  with  the  big  one. 

9  What  little  braaa  parta  are  in  the  box? 


0  Put  one  waaher  in  the  faucet. 

1  Graap  the  creaccnt  wrench. 

2  Za  it  in  it? 

3  What  little  braaa  parta  are  in  the  box? 


APPENDIX  E 


Utterances  Processed  ty  the  SRI  Speech  Understandinf  System* 


LO  Put  a  screw  in  the  hole. 

B  -  understood  correctly 
P  -  understood  correctly 
L3  What  part  is  in  the  hole? 

•  B  -  understood  correctly 
P  -  understood  correctly 
N1  Put  the  handle  on  the  faucet. 

B  -  understood  correctly 
P  -  understood  correctly 
N2  Screw  a  Oil  screw  in  the  handle. 

B  -  understood  correctly 
P  -  understood  correctly) 

M3  Is  there  a  crescent  wrench  in  the  box? 

B  -  understood  correctly 

P  -  missed  'a';  exceeded  limit;  'is  there  crescent 
wrench  ...' 

Nil  Unscrew  the  capnut  with  the  little  one. 

B  -  understood  correctly 

P  -  false  acceptances;  exceeded  limit;  'unscrew  the  ...' 
N6  Picx  up  the  bis  screwdriver. 

B  -  understood  correctly 
P  -  understood  correctly 
N8  How  many  parts  are  there? 

B  -  understood  corr^tly 

P  -  false  acceptances;  exceeded  limit;  'how  many  ...' 

N9  what  tools  are  in  the  box? 

B  -  'tool'  failed 
P  -  understood  correctly 
00  Pick  up  the  worn  crescent  wrench. 

B  -  understood  correctly 
P  -  understood  correctly 
02  How  many  washers  are  in  the  box? 

B  -  understooa  correctly 

P  -  understood  'How  many  wrenches  are  in  the  box?'; 

accepted  'washers'  with  lower  score  because  of  gap 
penalty 

03  There  is  a  big  screwdriver  on  the  box. 

B  -  understood  correctly 

P  *  false  acceptances;  exceeded  limit;  'there  is  a  Pis 
screwdriver  ...' 


*B»  p,  and  K  are  speakers  who  recorded  the  utterances. 
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05  Qrasp  the  handle  on  tne  faucet. 

B  -  understood  correctly 
P  -  understood  correctly 

08  How  many  81*  tools  are  there? 

B  -  'there'  tailed;  exceeded  limit;  'how  many  big  tools 
are  ...' 

P  -  understood  'How  many  big  tools  are  on  it?';  never 
tested  for  'there' 

09  Is  one  a  little  crescent  wrench? 

B  -  lap  between  'is'  and  'one';  'is  ...  one  little 
crescent  ...' 

P  -  priority  assignment  for  'one'  *,s  noun  (roup  too  low; 
never  tested  for  'a';  'is  one  crescent  wrench' 

P5  Is  there  a  little  tool  in  the  box? 

B  -  understood  correctly 
P  -  understood  correctly 

P8  What  little  brass  parts  are  in  the  box? 

B  -  understood  correctly 
P  -  understood  correctly 

qo  The  bif  brass  part  on  the  faucet  is  the  handle. 

B  -  false  acceptance  of  ’put*  at  beginning;  exceeded 
limit  before  testing  for  'the';  '...  brass  part  on 
the  faucet  . . . ' 

P  -  false  acceptances;  exceeded  limit;  'the  big  brass 
part  on  the  faucet  ...' 

01  The  little  part  on  the  handle  is  the  capnut. 

B  •  false  acceptances;  exceeded  limit;  'the  little  part 
on  the  . . . ' 

P  -  'little'  failed 

06  The  big  tool  is  a  crescent  wrench. 

B  -  'tool'  failed 
P  -  'tool'  failed 

08  How  many  big  brass  parts  are  there? 

B  *  understood  'How  many  big  brass  parts  are  the  handle?' 

error  in  grammar 
P  -  understood  correctly 

59  What  wrench  is  in  the  box? 

B  -  understood  correctly 
P  -  understood  correctly 

50  Screw  the  screw  in  it. 

B  -  understood  correctly 
P  -  understood  correctly 

51  Put  it  on  the  faucet. 

B  -  understood  correctly 
P  -  understood  correctly 

52  PICK  up  a  big  one. 

B  •  understood  'PicK  up  a  big  wrench.';  had  correct 
analysis  with  higher  priority  for  path,  but  vocal 
.*ry  at  end  of  utterance  resulted  in  looking  for 
longer  word 

P  -  understood  correctly 
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S3  I*  there  a  little  one  in  tne  box? 


B  - 


P  - 


understood  'Is  there  a  little  one  in  tne  faucet? '; 
accepted  'faucet'  in  spite  of  low  score  because  of 
high  priority  for  path;  never  tested  for  'box' 
understood  'Is  there  a  little  handle  in  a  box*  ; 
'one'  failed 
Sfc  Is  it  on  the  box? 

S  -  understood  correctly 
p  -  understood  correctly 

35  What  tools  are  in  the  big  one? 

S  -  understood  correctly 

p  -  understood  correctly 

36  Unscrew  a  little  brass  one. 

B  -  understood  correctly 

p  -  understood  correctly 

37  screw  a  screw  in  the  handle  with  it, 
i  -  'in'  failed;  'screw  a  screw  ...' 

P  -  'in'  failed;  'screw  a  screw  ...' 

Sft  Unscrew  the  capnut  with  the  big  one. 

i  -  'the'  failed;  'a'  accepted  at  that  place  but  witn 
low  rating;  exceeded  limit;  'unscrew  a  capnut  ... 
p  -  'one'  failed;  'unscrew  the  capnut  with  the  big 
35  what  little  brass  parts  are  in  the  box? 

B  -  'little'  failed 

p  •  false  acceptances;  exceeded  limit;  'what  little 
brass  parts  are  •••' 

ZO  Put  one  washer  in  the  faucet. 

B  -  understood  correctly 
p  -  understood  correctly 
K  -  understood  correctly 
Zi  Grasp  the  crescent  wrenen. 

P  -  understood  correctly 
K  -  understood  correctly 
72  Is  it  in  it? 

B 


•  •  • 


K  - 


understood  correctly 

understood  'is  there  a  wrench?';  nad  correct 
analysis  with  higher  priority  for  path,  but  vocal 
gry  at  end  of  utterance  resulted  in  looKing  for 
longer  word 
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